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ABSTRACT 


Models  of  aggregation  in  management  science  and  economics  are  not  consistent 
witli  micro-empirical  knowledge  of  individual  decision  making.  This  has  occurred 
as  a  result  of  using  heuristics  that  are  derived  from  behavioral  studies  which  focused 
on  discrete  incidents.  This  approach  fails  to  recognize  decision  making  as  a 
continuous  process  and  overlooks  the  importance  of  feedback. 

This  study  examines  the  performance  of  various  decision  strategies  (heuristics) 
in  dynamic  environments  through  computer  simulation.  Within  dynamic  task 
environments,  three  classes  of  strategies  are  examined:  (a)  feedback  oriented 
strategies,  (b)  non-feedback  oriented  strategies  and;  (c)  a  strategy  that  incorporates 
learning.  The  relative  efficacies  of  these  strategies  are  compared.  The  results  show 
that  feedback  oriented  strategies  achieved  a  higher  level  of  performance  than  non¬ 
feedback  oriented  strategies.  And  the  strategy  that  incorporated  learning 
outperformed  all  other  strategies.  A  few  abnormalies  exist  and  may  require 
additional  sampling.  The  implications  of  these  findings  for  command  decision 
making  indicate  that,  feedback  from  prior  military  actions  can  play  an  important  role 
in  adapting  existing  systems  to  meets  new  military  roles  in  changing  environments. 
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I. 


INTRODUCTION 


A.  BACKGROUND 

A  major  concern  in  research  on  decision  making  has  been 
the  use  of  heuristics.  Behavioral  decision  studies  have 
identified  heuristics  in  a  wide  variety  of  decision  making 
context.  Models  utilizing  heuristics  tend  to  work  well  in 
some  setting  and  provide  dysfunctional  consequences  in 
others.  Presently,  there  is  no  available  evidence  to 
explain  these  systematic  errors  or  identify  the  general 
conditions  under  which  heuristics  perform  well.  Because 
heuristics  are  organizational  strategies  that  humans  devise 
to  deal  with  inadequacies,  researchers  have  focused  their 
attention  on  decision  makers'  limited  information  processing 
system.  These  limitation  have  significant  consequences  in  a 
complex  decision  environments.  Understanding  how  decision 
makers  continuously  adapt  to  complex  changing  environments 
requires  careful  consideration  of  the  structure  of  the 
environment,  especially  defining  the  role  of  feedback.  One 
strategy  for  assessing  the  quality  of  human  decision  making 
is  the  use  of  simulation  techniques  to  measure  the 
performance  of  various  decision  strategies  (heuristics)  and 
their  sensitivity  to  variations  in  task  structure 
(Kleinmuntz,  1985). 
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B.  BXPBRIKEIITAL  TOOL 

Computer  simulation  modeling  makes  it  possible  to  study 
dynamic  decision  problems.  Because  dynamic  environments  are 
characterized  by  continual  changes,  both  autonomously  and  as 
a  result  of  the  decision  maker’s  action  and  real  time 
decision,  conventional  means  of  studying  decision  making  are 
no  longer  feasible.  A  viable  alternative  recognized  for 
sometime  now  (Simon,  1969) ,  is  the  use  of  simulation 
modeling  which  is  well  suited  to  represent  complexity, 
feedback,  nonlinearity,  and  time  lags  (Sterman,  1987) . 

Computer  modeling  is  the  programming  of  a  computer  to 
imitate  the  dynamic  behavior  of  a  real  or  hypothesized 
system  in  all  relevant  aspects.  Simulation  is  the 
development  and  use  of  models  to  aid  in  the  evaluation  of 
ideas  and  the  study  of  dynamic  systems  or  situations 
(McLeod,  1989). 

The  computer  simulation  model  used  in  this  experiment 
was  designed  to  perform  the  task  in  a  way  that  fits 
currently  available  data  about  human  behavior.  The 
structure  of  the  simulation  models  contain  two  distinct 
components  that  interact  with  each  other; 

1.  The  decision  environment  which  is  constructed  using 
difference  equations  and 

2.  The  decision  processes  of  individuals  modeled  by: 

a.  Default  strategies  commonly  used  in  studies  of 
behavioral  decision  making  or 

b.  Decision  strategies  that  incorporate  a  learning 
mechanism  such  as  statistical  techniques. 
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The  decision  environment  captures  the  physical  and 
institutional  structure  of  a  system  and  is  often  accurately 
portrayed.  Such  environment  may  reflect  the  flow  network  of 
information,  stock  market  activities,  etc.  The  decision 
process  or  decision  rules  corresponds  to  the  behavior  of  the 
individual  actor  and  is  often  difficult  to  represent.  Two 
primary  sources  that  assist  in  establishing  baseline 
decision  rules  are  the  results  from  behavioral  decision 
studies  (heuristics)  and  empirical  data. 

The  dimensions  proposed  by  Brehmer  and  Allard  (1991a) 
to  describe  dynamic  tasks  and  guide  experimentation  were 
used  as  a  reference  when  designing  the  model.  Complexity, 
difficulty,  randomness,  feedback  quality,  feedback  delays, 
and  strategies  were  factors  considered. 

Complexity  is  a  relative  concept  that  focuses  primarily 
on  control  and  is  defined  in  relation  to  the  subject's 
cognitive  capacity.  Since  an  underlining  limitation  in 
humans  is  the  number  of  system  elements  and  their  relations 
that  can  be  handled  at  one  time,  it  is  reasonable  to  define 
complexity  in  terms  of  system  elements  and  their  relations 
(Brehmer,  1991b). 

Difficulty  of  the  environment  is  often  viewed  as  a 
derivative  of  complexity.  However,  there  is  no  simple 
direct  correlation  between  the  number  of  elements  of  a 
system  and  the  difficulty  of  the  environment.  For  instance, 
in  a  complex  system  with  many  elements  and  interconnections 
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between  elements,  only  a  few  may  be  relevant  to  the  present 
decision.  As  a  result,  the  level  of  difficulty  may  be  low 
even  though  the  level  of  complexity  is  high.  However,  from 
a  continuous  perspective,  difficulty  can  be  assessed  in 
terms  of  gains  and  losses.  Gains  can  be  viewed  as  a  means 
of  increasing  available  options,  whereas  losses  can  be 
viewed  as  restrictive.  And  since  losses  are  weighted  more 
heavily  than  gains  (Kahneman  and  Tversky,  1979;  1981) 
difficulty  can  be  incorporated  through  the  use  of  severe 
penalty  functions  levied  on  the  quality  of  decisions.  For 
example,  when  investing  in  mutual  funds,  growth  funds  would 
appear  very  attractive  because  of  the  potentially  high  yield 
on  investment.  But  when  considering  the  level  of  risk 
(penalty  function)  associated  with  achieving  that 
potentially  high  yield,  the  investment  decision  becomes  more 
difficult  to  make. 

Random  variations  were  introduced  to  reflect  major 
areas  of  uncertainty  when  modeling  the  real  world.  For 
instance,  when  modeling  medical  decision  making,  random 
variations  could  be  used  as  multipliers  between  the 
treatments  given  to  patients  and  the  resulting  conditions  of 
the  patients.  Because  there  is  a  level  of  uncertainty  as  to 
the  effectiveness  of  the  treatments  or  the  significance  of 
the  patience's  nature  healing  process,  the  use  of  random 
variations  would  be  necessary.  For  this  experiment  random 


4 


variations  was  incorporated  in  the  form  of  drift, 
measurement  noise  and  model  noise. 

A  drift  random  variate  was  used  to  reflect  the 
direction  of  the  environment's  progress.  For  instance,  if 
an  individual  possessed  a  certain  amount  of  wealth,  the 
value  of  his  wealth  would  be  affected  by  the  inflation  or 
deflation  rate  regardless  of  his  investment  decision. 
Inflation  and  deflation  rates  reflect  the  direction  of  the 
economy,  and  are  considered  as  drift  variates. 

A  measurement  random  variate  was  used  to  adjust 
individual  factors  to  reflect  the  imprecision  in  decision 
process  measurements.  A  model  random  variate  was  used  to 
adjust  aggregates  to  reflect  the  imprecision  in  decision 
environment  measurements.  Consider,  for  example, 
constructing  a  model  to  define  the  gross  national  product 
(GNP)  at  any  time.  There  are  many  inaccuracies  associated 
with  measuring  factors  such  as  consumption,  governmental 
expenditures,  and  gross  investment  for  an  entire  nation. 
Measurement  random  variates  should  be  used  to  represent 
these  inaccuracies.  Secondly,  the  concept  of  GNP,  itself  is 
ambiguous  and  based  on  many  different  conventions  which  is 
suggestive  by  the  various  methods  use  to  determine  it. 

Model  random  variates  would  be  appropriate  to  reflect  the 
obscurity  associated  with  GNP. 

Feedback  is  information  about  the  gap  between  the 
actual  level  and  the  reference  level  of  a  system  parameter 
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that  is  used  to  affect  the  gap.  For  example,  information  on 
the  overbudgeting  on  contracts  by  a  contracting  agent  used 
to  cut  his  obligations  in  the  future  is  feedback.  The 
system  parameter  is  the  contracting  agent's  expenditures. 

The  reference  level  is  the  budgeted  expenditures;  the  actual 
level  is  the  actual  expenditures.  Information  on  how  to 
affect  the  gap  is  feedback  (Ramaprasad,  1983). 

Feedback  provides  information  about  the  outcome  of 
prior  actions,  changes  to  the  environment,  and  changes  as  a 
result  of  the  decision  maker's  previous  decisions.  This 
information  is  essential  in  human  information  processing  to 
help  develop  mechanisms  for  dealing  with  the  environment. 
Feedback  can  be  used  as  an  effective  tool  to  enhance  the 
quality  of  decisions. 

The  factors  associated  with  feedback  are  the  type  of 
feedback,  feedback  delay  and  feedback  quality.  There  are 
various  types  of  feedback  strategies  (i.e.,  outcome 
feedback,  cognitive  feedback,  and  feedforward),  however, 
this  experiment  was  design  to  utilize  outcome  feedback  only. 

Feedback  delays  are  the  periods  of  time  between  when 
the  action  takes  place  and  when  information  about  the 
effects  of  that  action  arrives.  In  complex  systems, 
feedback  delays  are  inevitable  and  may  occur  anywhere  in  the 
feedback  loop.  For  example,  during  Operation  Desert  Storm 
when  air  strikes  were  flown  over  Iraq,  there  was  a 
significant  feedback  delay  between  the  time  when  the  bombs 
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were  dropped  and  when  the  status  of  the  target  was 
determined.  In  many  cases,  secondary  missions  against  the 
same  target  were  flown  without  knowing  the  results  of  the 
first  attack. 

The  second  factor  is  the  quality  of  feedback.  In 
dynamic  task,  all  information  is  feedback  information,  but 
the  information  may  vary  in  quality  and  frequency.  In  our 
example  above,  various  sources  were  utilized  to  verify  the 
status  of  the  target  (i.e.,  CNN,  observation  aircraft, 
satellite  imaginary,  etc.).  However,  there  are  varying 
degrees  in  the  quality  of  information  provided  by  each  of 
these  source.  An  observer  on  the  ground  may  provide  more 
detailed  information  that  an  aerial  photography  from  an 
observation  aircraft. 

The  relation  between  the  decision  environment 
(characteristics  of  the  processes  to  be  controlled)  and  the 
decision  process  of  the  individual  (those  of  the  processes 
used  for  control)  defines  the  strategy  for  the  task. 

For  example,  an  investor  may  develop  a  strategy  for 
investing  his  money.  If  he  does  not  have  the  time, 
resources  or  know  how  to  adequately  track  the  stock  market, 
he  may  chose  a  time  valued  strategy,  where  he  would  invest 
regularly  regardless  of  the  fluctuations  in  the  market.  In 
this  experiment,  strategies  are  implemented  through  the  use 
of  decision  rules. 
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C.  RESEARCH  QUESTION 

Research  conducted  in  behavioral  decision  theory 
studies  has  identified  heuristics  used  by  people  in  a 
variety  of  decision  making  areas.  However,  this  research 
has  been  primarily  centered  on  individual  choice  in  static 
and  discrete  incidents.  Hogarth  (1981)  emphasized  that 
"judgment  is  part  of  an  interactive  process  that  people  use 
to  cope  with  the  environment"  and  that  "a  discrete- 
continuous  perspective  is  necessary  in  evaluating  judgmental 
heuristics. " 

Sterman  (1989a)  contends  that  experimental  studies  of 
the  "continuous,  adaptive  nature  of  judgmental  processes"  in 
a  dynamic  system  can  be  performed  in  the  laboratory  with 
computer  simulation  models.  Simulation  modeling  can 
represent  the  complexity  of  the  environment  and  the 
institutional  structure  allowing  for  controlled  manipulation 
and  accuracy. 

The  research  outlined  in  this  thesis  was  conducted  to 
examine  the  quality  of  decisions  made  by  individuals  in 
dynamic  decision  environments  and  how  the  quality  of 
decisions  in  such  environments  can  be  improved  through 
decision  support  tools.  Individual  behavior  was  simulated 
through  a  set  of  decision  rules.  These  decision  rules 
varied  in  levels  of  complexity  from  simple  to  complex.  Some 
of  the  decision  rules  utilized  feedback  oriented  strategies, 
while  others  incorporated  a  learning  mechanism.  Each  of  the 
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decision  rules  interacted  through  computer  simulation  with 
120  different  environments. 

D.  CONTRIBUTION 

The  use  of  computer  simulation  modeling  has  long  been 
recognized  as  a  viable  means  of  representing  complex, 
multifacet  environments  for  studying  human  behavior.  But 
until  recently,  dynamic  decision  studies  had  not  received 
the  attention  they  merit.  Presently,  progress  in  this  area 
is  slow  because; 

1.  of  the  difficulty  extending  experimental  methods 
used  to  study  individual  decisions  to  aggregate 
dynamic  settings, 

2.  the  decision  problems  do  not  fit  the  mold  for 
normative  theory,  and 

3.  analytical  solutions  are  difficult  to  find. 

The  goal  of  this  research  is  to  assist  in  developing 
formal  decision  rules  that  aquate  to  human  behavior,  provide 
a  means  of  exploring  alternative  assumptions  in  modeling, 
and  provide  strong  prediction  about  human  performance  that 
may  lead  to  testable  theories. 


II 


THEORETICAL  PREMISE 


A.  DYNAMIC  DECISION  MAXING 

The  descriptive  characteristics  of  a  dynamic  decision 
problem  are  that  (Brehmer,  1987) : 

1.  it  requires  a  series  of  decisions  aimed  at  reaching 
a  specific  goal, 

2.  the  decisions  are  interdependent, 

3.  the  environment  changes  both,  spontaneously  and  as  a 
result  of  the  decision  maker's  actions,  and 

4.  the  decision  are  made  in  real  time. 

An  example  of  a  dynamic  task,  would  be  an  F-15  pilot  engaged 
in  air  to  air  conflict.  The  pilot  must  make  a  series  of 
decisions  aimed  at  destroying  the  enemy  target.  Each 
decision  he  makes  will  affect  his  next  decision.  If  he 
chooses  to  descend  to  a  certain  attitude,  then  he  may 
restrict  his  maneuver  option  in  the  next  decision.  The 
situation  changes,  both  as  a  result  of  his  decisions  and  as 
a  result  of  the  enemies  actions.  The  enemy  aircraft  may 
choose  to  take  an  attack  posture  or  flee.  The  decision  that 
the  pilot  makes  are  in  real  time. 

This  means  that  decision  makers  must  be  able  to 
consider  the  impact  of  each  decision  on  future  decisions, 
recognize  the  constraints  created  by  previous  decisions 
(Brehmer,  1987)  and  realize  the  ability  to  correct  problems 
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created  by  previous  decisions  in  latter  decisions  (Hogarth 
1981)  . 

The  real-time  character  of  dynamic  decisions  requires 
the  decision  maker  to  response  quickly  to  the  demands  of  the 
environment.  This  places  an  element  of  stress  on  the 
decision  maker  to  exert  control  over  the  rate  at  which 
decision  have  to  be  made  and  to  devise  a  strategy  for  making 
good  decisions  (Brehmer,  1987) .  In  essence,  the  decision 
maker  must  find  "a  way  to  use  one  process  to  control  another 
process"  (Brehmer  and  Allard,  1991a) . 

B.  STATIC  VS  DYNAMIC  DECISION  ENVIRONMENTS 

When  examining  human  judgmental  ability,  it  is 
necessary  to  distinguish  between  static  and  dynamic  decision 
environments.  Much  of  the  research  conducted  in  behavioral 
decision  theory  on  decision  making  consists  of  discrete 
occurrences  taking  place  in  a  seemingly  static  environment. 
Nevertheless,  these  occurrences  are  a  subset  of,  and  serve 
to  accentuate,  continuous  processes  in  a  dynamic 
environment.  Since  most  decisions  are  made  in  a  dynamic  as 
opposed  to  static  environment,  it  is  argued  that  biases 
noted  in  discrete  occurrences  result  from  heuristics  that 
are  useful  in  more  natural  continuous  environments. 

According  to  Hogarth  (1981)  failure  to  study  and  evaluate 
judgment  as  a  continuous  process  has  had  two  notable 
pitfalls: 


First,  insufficient  attention  has  been  paid  to  the 
effects  of  feedback  between  organism  and  environment. 

Second,  although  judgmental  performance  has  been  evaluated 
according  to  the  principles  of  optimal  behavior  implied  by 
decision  theory  and  the  probability  calculus,  few 
researchers  have  questioned  whether  the  assumptions  of  such 
models  apply  to  continuous  processes.  (p.l98) 

C.  HOW  DYNAMIC  DECISION  MAKING  CAN  BE  STUDIED 

The  study  of  dynamic  task  provides  unique  challenges  in 
that  standard  normative  theories  for  decisions  making  do  not 
apply  (Brehmer,  1987)  and  optimal  solution  are  impossible  to 
obtain  through  analytical  means  (Sterman,  1989b) .  For  these 
reasons,  studies  of  dynamic  decision  making  have  largely 
abandoned  the  normative  approach  and  concentrated  on 
empirical  analysis.  A  general  framework  for  studying 
dynamic  decision  making  was  adopted  to  guide  research. 

Brehmer  (1987)  pointed  out  (as  denoted  by  Broadbent, 
Fitzgerald  and  Broadbent  (1986),  Rapoport  (1975)  and 
MacKinnon  and  Wearing  (1985)  earlier)  that  the  goal  of 
decision  making  is  to  achieve  control  and  that  decisions  are 
made  to  achieve  a  desired  state  of  affairs,  or  keep  a  system 
at  a  desired  state.  From  this  observation,  it  was  suggested 
that  control  theory  would  be  a  viable  approach  to  studying 
dynamic  decisio”  making.  It  was  later  determined  that  the 
control  theory  approach  was  inappropriate  because  of  its 
inability  to  handle  patterns  and  gestalts  (Bainbridge, 

1981)  . 

However,  control  theory  was  productive  in  that  it 
defined  both  the  conditions  for  the  system  and  the 


properties  of  the  decision  maker,  necessary  to  control  the 
system.  Conditions  for  the  system  are  that  it  must  be 
possible  to  ascertain  and  affect  the  state  of  the  system. 
Properties  of  the  decision  maker  are  that  there  must  be  a 
goal  and  a  model  of  the  system.  The  problem  for  research  is 
concerned  with  the  properties  of  the  decision  maker  as  a 
function  of  the  conditions  of  the  system  being  controlled 
(Brehmer,  1987) .  This  task  is  not  as  simple  as  it  might 
appear.  Conditions  of  the  system  are  abstract  and  it  is 
unclear  as  to  what  determines  and  affects  the  state  of  the 
system.  The  second  problem  involves  adopting  a  correct 
strategy  (i.e.,  feedback,  feedforward  or  some  combination 
thereof) . 

Because  of  the  complexity  of  most  dynamic  systems, 
traditional  methods  of  field  studies  are  not  feasible. 
Computers  have  made  it  possible  to  create  dynamic 
simulations  (commonly  called  "roicroworlds")  and  to  study  how 
subjects  interact  with  such  complex  environments. 

In  microworld  experiments  the  decision  problems  are  not 
controlled  by  experimenter,  but  by  the  behavior  of  the 
decision  maker.  The  state  of  the  s;^  ;tem  at  any  given  moment 
is  reliant  on  both  the  system's  characteristics  and  the 
decision  maker's  decisions.  Since  the  independent  variables 
of  the  experiment  are  the  system's  characteristics,  the 
decision  maker's  strategies  must  be  the  area  of  focus. 
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The  experimental  approach  was  used  to  examine  our 
research  questions.  In  this  approach,  subjects'  performance 
in  simulations  with  varying  characteristics  are  compared. 


0.  IMPORTANCE  OF  FEEDBACK  IN  DYNAMIC  DECISION  ENVIRONMENTS 

Hogarth  (1981)  laments  the  "insufficient  attention" 
paid  "to  the  effects  of  feedback  between  organism  and 
environment."  Feedback,  not  only  refers  to  outcome 
feedback,  but  also  encompasses  environmental  changes,  and 
changes  as  a  result  of  the  decision  maker's  previous 
decisions.  Essentially  all  human  judgment  is  used  to 
facilitate  action  which  induce  feedback  that  is  central  to 
human  judgmental  ability  to  cope  with  the  environment. 

These  events  create  a  judgment-action-outcome  feedback  loop. 
The  feedback  is  often  immediately  available,  however, 
feedback  delays  are  indicative  of  roost  dynamic  systems. 
Hogarth  (1981)  suggests  that  the  very  "ubiquity"  of  feedback 
has  caused  its  importance  as  a  part  of  this  loop  to  go 
unnoticed.  As  Powers  (1973)  stated: 

All  behavior  involves  strong  feedback  effects,  whether  one 
is  considering  spinal  reflexes  or  self-actualization. 
Feedback  is  such  an  all-pervasive  and  fundamental  aspect  of 
behavior  that  it  is  as  invisible  as  the  air  we  breathe. 

Quite  literally  it  is  behavior — we  know  nothing  of  our  own 
behavior  but  the  feedback  effects  of  our  own  outputs,  (p. 
351) 

1.  Judgmental  Accuracy 

Different  degrees  of  judgmental  accuracy  are 
required  in  discrete  and  continuous  processes.  Imagine 
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predicting  future  sales  in  an  organization.  Choice  is 
represented  by  the  selection  of  a  target  sales  quantity. 
Consider  the  probability  of  reaching  that  sales  quantity, 
randomly,  without  having  any  means  to  predict  the  behavior 
of  the  market.  Provided  that  sales  are  being  made,  the 
probability  of  reaching  the  target  sales  quantity  in  a 
discrete  incident  is  a  increasing  ratio  of  the  target  sales 
quantity  to  the  distance  from  the  target  sales  quantity. 
Starting  from  the  same  point,  a  continuous  process,  by 
moving  toward  the  target  sales  quantity  and  periodically 
checking  the  quantity  of  sales,  could  transform  a  low 
initial  probability  to  almost  certainty  without  exercising 
much  predictive  abilities.  For  a  continuous  process,  the 
probability  of  accurately  predicting  some  economic  variable 
increases  as  a  function  of  time.  This  example  highlights 
two  critical  dimensions  of  judgmental  achievement:  (a)  the 
implied  degree  of  commitment  and  (b)  that  the  availability 
and  interpretation  of  feedback  is  more  important  than 
predictive  ability  (Hogarth,  1981) . 

2 .  Commitment 

Feedback  is  essential  to  human  judgmental  ability 
to  make  adaptive  responses  by  reducing  the  implied 
commitment.  Outcome  feedback  provides  information  about  the 
response,  whereas  process  feedback  provides  information 
concerned  with  the  relations  that  create  those  responses. 
Outcome  and  process  feedback  are  products  of  discrete 
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incidents  research.  In  continuous  processes,  feedback  is 
more  corrective  in  nature,  in  that  it  allows  for  changes  in 
the  general  direction  of  judgment  (Hogarth,  1981) .  Problems 
created  by  earlier  decisions  can  by  corrected  during  latter 
decisions.  Corrective  feedback  gives  the  illusion  of  a 
planned  complex  series  of  behavior  being  performed  by  the 
decision  maker  when  actually  they  are  simple  actions 
performed  across  time  (Hogarth,  1981) .  This  incrementally 
approach  greatly  reduces  the  level  of  commitment  implied  by 
a  specific  action  as  compared  to  level  of  commitment  obtain 
from  complex  calculations  with  a  more  discrete  approach.  In 
continuous  processes,  conditions  involving  feedback  greatly 
influences  task  complexity.  Frequency  and  speed  of 
corrective  actions  are  therefore,  important  variables  when 
characterizing  judgmental  task  (Powers,  1978) . 


E.  HYPOTHESIS 

Two  primary  hypothesis  guide  the  research  questions. 
The  first  primary  hypothesis  addresses  learning  in  decision 
processes.  This  is  accomplished  by  comparing  performance 
measures  of  decision  processes  to  those  of  decision 
processes  that  incorporate  learning  in  corresponding 
decision  environments.  We  would  expect  decision  processes 
with  learning  to  perform  better  than  those  without  when 
operating  in  the  same  environment.  The  first  hypothesis  is 
therefore: 
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Decision  processes  that  incorporate  learning  would  out 
perform  other  decision  processes  interacting  in  similar 
environments . 

The  second  hypothesis  is  concerned  with  system 
characteristics  that  affect  decision  processes.  This  is 
accomplished  by  measuring  the  performance  of  each  decision 
process  in  each  decision  environment.  Each  decision 
environment  have  varying  degrees  of  complexity  (details  on 
the  constructs  the  decision  environments  provided  in  Chapter 
III) .  We  would  expect  that  decision  processes  would  perform 
better  when  operating  in  a  less  complex  environment.  This 
leads  us  to  the  second  hypothesis: 

Decision  processes  interacting  in  simple  environments  would 
out  perform  the  same  processes  in  complex  environments. 
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Ill 


METHOD 


A.  TASK  EMVIROMMEllT 

1.  Dynanic  Decision  Task 

The  decision  environment  used  here  did  not  take  on 
a  specific  application,  but  contains  the  general  structure 
that  encompass  many  other  decision  environments.  The  basic 
task  is  to  analyze  the  system,  use  the  cues  to  make 
inferences  to  the  system's  condition  and  then  select  the 
appropriate  strategy.  The  goal  of  the  task  is  to  take  an 
initial  amount  and  maximize  its  value  through  various 
decision  strategies. 

2 .  Decision  Environment 

Three  levels  of  complexity  were  tested.  These 
were  the  number  of  elements,  the  relations  between  elements 
and  random  variations.  The  number  of  elements  comprised 
models  of  5  and  10  variables.  Relations  between  elements 
were  split  into  two  factors;  casual  structure  and  time  lags. 
The  casual  structure  refers  to  the  type  of  feedback 
structure.  The  casual  structure  in  the  models  are 
classified  as  positive,  negative,  or  mixed.  The  time  lag 
indicates  the  elapsed  time  between  when  an  action  occurs  and 
when  the  feedback  from  that  action  is  observed.  Time  lags 
in  the  models  are  classified  as  high  or  low.  High  indicates 
that  feedback  is  available  for  50%  or  less  of  the  observed 


periods  at  the  time  of  the  present  judgment.  This  criterion 
indicates  that  there  is  a  long  lag  time  between  when  the 
decision  is  made  and  when  feedback  from  that  decision  is 
available.  Low  time  lags  mean  that  feedback  is  available 
for  more  than  50%  of  the  observed  periods  at  the  time  of  the 
present  judgment.  This  includes  the  case  when  feedback  is 
immediately  available. 

Random  variation  was  separated  into  three  factors; 
drift,  measurement  noise,  and  model  noise.  It  was  initiated 
from  a  large  randomly  generated  table  (110  columns  X  10,000 
rows) .  The  values  for  the  table  was  produced  from  a  random 
number  generator  with  a  seed  of  48.  Columns  0-99  were 
allocated  for  measurement  variate  and  columns  100-109  for 
model  variate.  The  random  values  in  the  table  was  scaled  to 
a  specific  range  between  1  and  -1  to  moderate  their  impact. 

An  upward  drift  was  assigned  an  arbitrary  value  of  0.5, 
a  downward  drift  -0.5  and  no  drift  0.  The  drift  value, 
manipulated  algebraically  with  the  contents  of  the  randomly 
generate  table,  disseminated  the  effect  of  the  drift 
throughout  the  experiment.  Drift  was  operationalized  with 
the  following  equation,  embedded  within  two  iterative 
structures  which  manipulated  the  table: 

random [ i ][ j ]=random[i] [j ]+ (i*drift) /HAX_PERIODS 

Measurement  variate  was  added  to  each  element  at  the 
time  of  processing.  Model  variate  was  added  to  the 
aggregates  during  processing  to  introduce  uncertainty. 
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DECISION  ENVIRONMENT 

number  of 

casual 

time 

elements 

environment 

structure 

Isa 

5 

simple 

negative 

low 

positive 

mixed 

high 

5 

complex 

negative 

low 

positive 

mixed 

high 

10 

simple 

negative 

low 

positive 

high 

10 

complex 

negative 

low 

positive 

mixed 

high 

Five  models  of  each  of  the  combinations  in  Table  1. 
were  constructed  producing  a  total  of  120  models  of  the 
decision  environment.  Five  models  of  each  were  chosen  to 
provide  validity  and  to  reinforce  observed  results. 
Mathematical  representations  of  the  models  are  contained  in 
the  Appendix. 

The  models  of  the  decision  environment  were  constructed 
utilizing  random  generators.  Random  values  for  the  variable 
coefficients  were  produced  and  scaled,  so  that  the  sum  of 
the  coefficients  would  be  equal  to  1.  Negative  signs  were 
assigned  to  the  coefficients  to  indicate  negative  casual 
structures.  Mixed  casual  structures  were  formed  by 
assigning  negative  signs  at  random.  For  low  lag  times,  the 
criteria  was  set  for  lag  times  lower  than  50%  of  the 
observed  periods.  For  high  lag  times,  the  criteria  was  set 
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for  lag  times  greater  than  or  equal  to  50%  of  the  observed 
periods.  For  the  interconnections,  the  variables  were 
randomly  generated  within  a  range  from  0  to  the  number  of 
elements. 

3.  Decision  Strategies 

Decision  strategy  for  a  task  is  defined  by  the 
relations  between  the  decision  environment  and  the  decision 
processes  used  to  control  that  environment.  These  decision 
strategies  are  implemented  through  the  use  of  decision 
rules.  Hogarth  (1981)  speculates  that  simple  decision  rules 
which  are  known  to  be  within  human  cognitive  abilities  can 
perform  as  well  as  complex  rules.  Studies  have  shown  that 
for  series  that  do  not  conform  to  known  model  of  their 
characteristics  change,  simpler  models  provide  more  accurate 
forecast  (Makridakis  and  Hibon,  1979) .  For  these  reasons, 
the  following  simple  strategies  for  weighted  moving 
averages,  moving  averages,  random  arbitrary  strategy, 
constant  arbitrary  strategy  and  no  action  strategy  were 
adopted. 

A  strategy  for  weighted  moving  averages  involves 
differentially  weighing  the  averages  of  the  observed  periods 
with  emphasizes  on  the  most  recent  observation.  The 
weighing  distribution,  assigns  50%  of  the  weight  to  the  most 
recent  observation  and  smaller  weights  as  the  period  of 
observation  become  more  distant  from  the  most  recent 
decision.  The  present  decision  D  is  determined  by  applying 
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a  weighing  distribution  ffGT  to  the  wealth  WL  for  the 
previous  observed  periods  OP  and  is  given  by: 

D  ^(WGT)WL,.t  +  (WGT-(l/OPX2))WL,,j+  (WGT- (2/OPX2)  )WL,.3  +  ... 
where  WGT  =  (0 .5XOP) / (OPX2) 

This  a  feedback  oriented  strategy  that  takes  into  account 
the  information  provided  from  previous  decisions. 

A  strategy  for  moving  averages  involves  taking  the 
average  of  the  observed  periods  as  judgment  for  the  present 
decision.  The  present  decision  D  is  determined  by  averaging 
the  wealth  NL  from  the  previous  observed  periods  OP  and  is 
given  by: 

D  =WL,.y  +  WL,.J  +  WL,.3  +  .  .  . 

This  also  a  feedback  oriented  strategy  that  utilizes  the 
results  of  previous  actions  to  determine  the  present 
decision.  The  feedback  from  the  all  of  the  observed  periods 
are  considered  of  equal  value. 

A  random  arbitrary  strategy  involves  randomly  selecting 
a  value  as  judgment  for  the  present  decision.  This  is 
accomplished  in  this  model  by  taking  a  percentage  of  the 
incremental  value  of  the  most  recent  observation  as  judgment 
for  the  present  decision.  This  strategy  is  non-feedback 
oriented  and  can  be  considered  as  a  form  of  trial-and-error 
rather  than  optimizing  (Hogarth  and  Makridakis,  1981) . 

A  constant  arbitrary  strategy  involves  using  a 
predetermined  value  as  judgment  for  the  present  decision. 
This  strategy  is  similar  to  that  of  the  random  arbitrary 
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strategy.  The  only  different  is  that,  the  value  remain 
constant  throughout  the  experiment.  This  approach  can  be 
compared  to  the  time  investment  strategies  use  by  investor 
where  they  invest  a  constant  amount  regularly  regardless  of 
the  fluctuations  of  the  market.  This  strategy  is  not  affect 
by  feedback  and  usually  has  a  high  level  of  commitment 
associated  with  it  (Hogarth  and  Makridakis,  1981) . 

A  no  action  or  do  nothing  strategy  involves  taking  no 
action.  Although,  this  may  appear  to  be  a  easy  decision, 
there  are  visible  penalties  associated  with  this  type  of  a 
strategy  (i.e.,  value  changes  as  a  result  of  environmental 
drift) .  The  decision  to  take  no  action  may  still  involve  a 
significant  level  of  evaluating  alternatives  although  no 
action  is  taken  (Hogarth  and  Makridakis,  1981) . 

In  addition  to  the  above  strategies,  a  multiple 
regression  algorithm  was  used  to  incorporate  learning.  A 
learning  system  has  two  goals;  to  deal  with  complex  real- 
world  decision  making  and  to  provide  correct  solutions. 
Decision  makers  are  constantly  faced  with  making  important 
decisions  and  in  doing  so  they  rely  on  prior  experience. 
Learning  systems  make  decisions  based  on  accumulated 
experience  contained  in  successfully  solved  cases  (Weiss  and 
Kulikowski,  1990). 

The  multiple  regression  algorithm  utilizes  cues  from 
observed  periods  to  make  inferences  as  to  the  condition  of 
the  environment.  Averages  of  these  cues  are  then  used  to 
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produce  beta  values  to  determine  the  weighing  distribution 
of  the  cues  in  the  present  decision.  The  sum  of  weighing 
distribution  across  elements  was  set  equal  to  1.  This 
strategy  determines  the  importance  of  each  of  the  cues  in 
previous  decisions,  thereby  allowing  for  strong  emphasis  to 
be  placed  on  the  cues  relative  to  the  present  decision. 

4 .  Dependent  Measures 

The  performance  of  each  decision  strategy  was 
operationalized  through  two  dependent  measures:  the  mean 
wealth  (WLMEAN) ,  and  the  mean  accumulated  wealth  (ENDWL) . 

The  mean  wealth  is  the  mean  of  the  incremental  changes 
between  periods  or  iterations.  The  mean  accumulated  wealth 
or  ending  wealth  is  the  mean  of  the  aggregate  sum  of  the 
incremental  changes. 

Two  additional  dependent  variables  were  used  in  the 
analysis  process  to  determine  the  statistical  significance 
of  system  parameters:  the  standard  deviation  of  wealth 
(WLSTD) ,  and  the  mean  periods  (PERIODS) .  The  standard 
deviation  of  wealth  is  self  explanatory.  The  mean  periods 
is  the  mean  of  the  number  of  periods  or  iterations  that  the 
experiment  successfully  completed  prior  to  terminating. 

The  affects  of  all  four  dependent  variables  in  the  analysis 
process  are  presented  in  terms  of  probabilities  (P)  and  F 
statistical  values. 
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E.  CONDUCT  OF  THE  EXPERIMENT 

The  initial  conditions  of  the  experiment  were  set  as 
follows: 

1.  number  of  iterations  1000 

2.  initial  value  10 

3 .  noise  present 

4.  maximum  input  value  for  random  variations  10 

5.  minimum  input  value  for  random  variations  -10 

6.  threshold  value  -1000 

7.  no  model  changes 

8.  drift  variate  -0.5 

The  number  of  iterations  determined  how  long  the  simulation 
would  run  under  ideal  conditions.  The  number  of  iterations 
remained  constant  throughout  the  experiment.  Data  on 
shorter  iteration  periods  could  be  derived  from  the  output 
produced.  The  initial  value  indicated  the  starting  value 
for  the  aggregate  total  and  was  used  only  at  the  beginning 
of  each  simulation.  The  two  input  values  used  in  an 
algebraic  equation  specified  the  range  for  the  random 
variations.  The  range  was  set  for  values  between  1  and  -1 
throughout  the  experiment.  The  threshold  value  or  endpoint 
determined  the  condition  at  which  the  simulation  model  would 
terminate.  If  the  accumulated  wealth  moved  below  the 
endpoint  value  the  simulation  would  end.  The  endpoint  value 
remained  constant  throughout  the  experiment.  Data  on  larger 
threshold  values  could  be  derived  from  the  output  produced. 
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A  single  decision  model  was  observed  during  each 
simulation,  therefore,  no  model  changes  were  indicated. 
Decision  models  were  arranged  in  groups  of  five  based  on  the 
factors  discussed  in  section  3.  Of  the  five  model  series,  a 
negative  drift  variate  (-0.5)  was  used  in  combination  with 
the  first  two  decision  models,  no  drift  variate  with  the 
third  model,  and  a  positive  drift  variate  (0.5)  with  the 
last  two  models  of  the  series. 
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IV 


RESULTS 


A.  BXPBRIMEXITAL  RESULTS 

Even  the  limited  group  of  task  variables  and  decision 
strategies  described  in  Chapter  III  allow  for  a  large  number 
of  simulation  experiments.  In  this  study,  a  factorial 
design  was  used  for  evaluating  the  six  alternative 
strategies.  The  experiments  were  conducted  to  detect 
specific  interactions  among  task  variables  as  well  as  task 
variable-by-strategy  interaction.  A  two  stage  approach  to 
designing  the  experiment  was  used.  The  first  stage 
consisted  of  comparison  of  six  strategies  across  factorial 
manipulation  of  the  task  parameters.  The  second  stage 
consisted  of  comparison  of  decision  strategies  across  the 
manipulations  of  single  and  combined  task  parameters. 

The  first  analysis  compared  the  six  different  decision 
strategies  across  manipulations  of  four  parameter:  (1) 
number  of  elements,  (2)  complexity,  (3)  causal  structure, 
and  (4)  time  lag.  The  expected  results  would  be  for  all  of 
the  decision  strategies'  performance  to  improve  as  the 
number  of  elements  and  complexity  increase,  while  increased 
time  lag  should  have  a  negative  impact.  The  results  of  the 
experiment  are  summarized  in  Tables  2  and  3  based  on  the 
mean  value  of  wealth  and  accumulated  wealth. 
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TABLE  2.  MEAN  VALUE  OF  WEALTH 

Strategies 


NE 

C 

CS 

TL 

A 

K 

M 

N 

R 

W 

5 

simple 

neg 

low 

-1.32 

-2.26 

-0.52 

-0.55 

-0.34 

-0.82 

hi 

-1.35 

-2.29 

-0.52 

-0.51 

-0.31 

-0.83 

pos 

low 

-2-13 

-2.71 

-1.18 

-0.52 

-1.36 

-1.67 

hi 

-2.30 

-2.95 

-1.26 

-0.72 

-1.35 

-1.80 

mix 

low 

-1.64 

-2.61 

-0.65 

-0.62 

-0.33 

-1.04 

hi 

-1.82 

-2.63 

-0.78 

-0.33 

-0.68 

-1.25 

5 

complex 

neg 

low 

-1.38 

-2.33 

-0.49 

-0.54 

-0.09 

-0.81 

hi 

-1.30 

-2.28 

-0.47 

-0.55 

-0.06 

-0.76 

pos 

low 

-3.00 

-3.42 

-1.84 

0.10 

-2.67 

-2.52 

hi 

-2.44 

-3.04 

-1.54 

1.12 

-1.70 

-2.01 

mix 

low 

-1.64 

-2.57 

-0.66 

-0.57 

-0.56 

-1.07 

hi 

-1.67 

-2.44 

-0.75 

-0.26 

-0.54 

-1.15 

10 

simple 

neg 

low 

-2.07 

-2.96 

-0.85 

-0.32 

0.26 

-1.38 

hi 

-2.05 

-2.84 

-0.92 

-0.56 

0.10 

-1.44 

pos 

low 

-4.47 

-4.95 

-2.53 

-1.15 

-2.53 

-3.67 

hi 

-3.92 

-4.33 

-2.24 

-0.84 

-2.07 

-3.21 

mix 

low 

-2.37 

-3.33 

-0.97 

-0.30 

0.18 

-1.61 

hi 

-2.37 

-3.17 

-1.08 

-0.61 

-0.14 

-1.69 

10 

complex 

neg 

low 

-1.85 

-2.57 

-0.72 

-0.59 

0.74 

-1.15 

hi 

-1.72 

-2.60 

-0.80 

-0.60 

0.42 

-1.27 

pos 

low 

-4.22 

-7.50 

-5.30 

2.68 

-6.95 

-6.54 

hi 

-4.36 

-4.83 

-3.13 

0.79 

-3.59 

-3.88 

mix 

low 

-2.00 

-2.89 

-0.85 

-0.61 

0.62 

-1.35 

hi 

-2.26 

-3.00 

-1.02 

-1.01 

0.02 

-1.61 

KEY: 

NE  =  Number  of  Elements 
C  =  Complexity 
CS  =  Causal  Structure 
TL  =  Time  Lag 


STRATEGIES: 

A  = 
K  = 
M  = 
N  = 
R  = 
W  = 


Random  Arbitrary 
Constant  Arbitrary 
Moving  Average 
Do  Nothing 
Regression 

Weighted  Moving  Average 
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Strategies 


NE  C  CS  TL  A  K  H  N  R  W 


5  simple  neg  low 
hi 

pos  low 
hi 

mix  low 
hi 

5  complex  neg  low 
hi 

pos  low 
hi 

mix  low 
hi 

10  simple  neg  low 
hi 

pos  low 
hi 

mix  low 
hi 

10  complex  neg  low 
hi 

pos  low 
hi 

mix  low 
hi 


-420.59 

-419.39 

-391.01 

-373.00 

-412.54 

-397.48 

-412.82 

-422.05 

-351.50 

-364.14 

-417.99 

-401.98 

-409.20 

-398.30 

-344.60 

-317.81 

-401.16 

-389.77 

-415.73 

-396.75 

-334.31 

-267.53 

-415.93 

-383.42 


-473.06 

-455.77 

-423.23 

-420.72 

-462.26 

-435.28 

-441.56 

-457.05 

-345.95 

-424.65 

-470.50 

-434.26 

-458.82 

-439.16 

-371.42 

-355.98 

-439.39 

-423.52 

-464.27 

-434.39 

-274.71 

-302.67 

-455.21 

-414.30 


-257.62 

-262.11 

-392.22 

-376.27 

-310.26 

-358.56 

-244.66 

-238.53 

-374.20 

-352.84 

-319.70 

-327.05 

-393.34 

-389.39 

-359.77 

-339.00 

-388.84 

-384.61 

-339.70 

-368.58 

-281.16 

-274.73 

-368.35 

-370.36 


-261.52 

-254.60 

-189.57 

-265.87 

-294.02 

-103.84 

-270.88 

-274.36 

313.90 

416.07 

-171.55 

-48.31 

-143.65 

-261.35 

-279.20 

-175.05 

-72.90 

-122.65 

-245.89 

-279.51 

1239.89 

456.89 

-263.23 

-229.48 


-160.83 

-151.75 

-454.37 

-365.56 

-165.28 

-270.41 

-47.24 

-13.42 

-460.71 

-336.98 

-272.10 

-192.97 

148.00 

59.76 

-414.26 

-317.13 

75.04 

-22.01 

397.14 

210.53 
-310.51 
-232.74 

317.53 
9.38 


-382.14 

-377.38 

-384.89 

-183.30 

-384.44 

-387.32 

-388.38 

-378.69 

-358.38 

-344.37 

-396.27 

-382.17 

-381.39 

-373.80 

-331.58 

-304.29 

-378.15 

-368.88 

-380.91 

-375.76 

-255.09 

-255.29 

-378.77 

-370.46 


KEY: 

NE  =  Number  of  Elements 
C  =  Complexity 
CS  =  Causal  Structure 
TL  =  Time  Lag 


STRATEGIES: 

A  =  Random  Arbitrary 
K  =  Constant  Arbitrary 
M  =  Moving  Average 
N  =  Do  Nothing 
R  =  Regression 
W  =  Weighted  Moving  Average 
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Direct  interpretation  of  the  proportion  of  observed 
periods  should  be  done  in  light  of  the  fact  the  proportion 
based  upon  50  observations  for  high  time  lags  and  30 
observations  for  low  time  lags  are  subject  to  considerable 
sampling  variability.  Differences  of  more  than  0.39  between 
decision  strategies  are  considered  as  statistically 
significant. 

Not  surprisingly,  the  regression  strategy  outperformed 
many  of  the  other  strategies.  However,  what  is  surprising, 
is  the  performance  of  the  do  nothing  strategy .  In  tasks 
where  the  causal  structure  is  positive,  the  do  nothing 
strategy  outperforms  all  others  including  regression.  The 
best  performance  of  all  tasks  occurred  under  the  do  nothing 
strategy  with  parameter  of  10  elements,  complex  environment, 
positive  causal  structure,  and  a  low  time  lag.  The 
regression  strategy  performed  well  with  parameters  of  10 
elements,  and  a  negative  or  mixed  causal  structure.  When 
comparing  the  two  arbitrary  strategies,  the  random  strategy 
performed  slightly  better  than  the  constant  strategy  under 
all  conditions.  When  comparing  the  two  moving  average 
strategies,  the  moving  average  performed  slightly  better 
than  the  weighted  moving  average  under  all  conditions. 

Within  all  strategies,  except  the  do  nothing  strategy,  tasks 
with  a  positive  causal  structure  performed  worst  than  all 
other . 
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TABLE  4.  MAIN  EFFECTS  AND  INTERACTIONS  OF 
COMBINED  STRATEGIES 


WLMEAN 

WLSTD 

PERIODS 

ENOWL 

Effects 

P  F 

P  F 

P  F 

P  F 

c 

0.2582 

1.28 

0.0001 

27.77 

0.4749 

0.51 

0.0475 

3.94 

cs 

0.0001 

76.99 

0.0001 

158.18 

0.0001 

100.45 

0.6142 

0.49 

TL 

0.1796 

1.80 

0.1676 

1.91 

0.6193 

0.25 

0.4397 

0.60 

NE 

0.0001 

39.13 

0.0001 

337.16 

0.0001 

36.68 

0.5393 

0.38 

S 

0.0001 

57.12 

0.0001 

69.30 

0.0001 

79.14 

0.0001 

23.92 

CxNE 

Q.01S4 

4.20 

0.0001 

21.22 

0.0431 

3.16 

0.0121 

4.44 

CxCS 

0.5171 

0.42 

0.0036 

8.52 

0.3059 

1.05 

0.9944 

0.00 

KEY:  C 

3B 

Complexity 

WLMEAN 

CS 

s 

Causal  Structure 

WLSTD 

TL 

=s 

Time  Lag 

ENDWL 

NE 

Number  of  Elements 

=  Mean  value  wealth 
=  Standard  deviation 
=  Ending  Wealth 


Tables  4-10  present  the  results  of  an  analysis  of 
variance.  The  tables  shov;  an  bold  print  those  parameters 
that  are  statistically  significant  (p<0.05)  within  each 
decision  strategy  across  four  dependent  variables:  (1)  mean 
wealth,  (2)  standard  deviation,  (3)  mean  periods,  and  (4) 
ending  wealth. 

Table  4  depicts  an  overall  analysis  containing  all 
decision  strategies.  The  causal  structure,  number  of 
elements,  and  decision  strategy  have  a  strong  emphasis  on 
the  mean  wealth.  The  significance  of  the  complexity-number 
of  elements  can  be  attributed  to  the  effects  of  the  number 
of  elements. 
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The  wealth  standard  deviation  is  strongly  influenced  by 
the  complexity,  causal  structure,  number  of  elements, 
decision  strategy,  and  the  complexity-number  of  elements. 

To  a  lesser  degree,  the  complexity-causal  structure  is 
significant. 

The  mean  periods  is  effected  by  the  causal  structure, 
number  of  elements,  decision  strategy  and,  to  a  lesser 
degree,  the  complexity-number  of  elements. 

The  mean  ending  wealth  is  strongly  influenced  by  the 
decision  strategy  and,  to  a  lesser  degree,  the  complexity. 
The  effects  of  the  complexity-number  of  elements  can  be 
attributed  to  the  emphasis  on  complexity.  The  effect  of  the 
complexity-strategy  is  a  combination  of  the  emphasis  on  both 
parameters . 

As  revealed  in  the  earlier  comparison,  there  is  a 
strong  emphasis  across  all  variables  on  the  decision 
strategy  used.  Causal  structure  and  the  number  of  elements 
are  equally  significant.  However,  time  lag  nor  complexity 
plays  an  essential  role  in  overall  performance.  The  effects 
of  the  complexity-number  of  elements  can  be  attributed  to 
the  significance  of  the  number  of  elements. 

Table  5  presents  the  results  for  the  learning  strategy 
using  regression.  The  causal  structure  and  complexity  have 
strong  emphasis  on  the  mean  wealth.  The  emphasis  of  the 
complexity-causal  structure  can  be  attributed  to  the  affects 
of  the  individual  parameters. 
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The  wealth  standard  deviation  and  mean  periods  are 
strongly  influenced  by  the  causal  structure,  number  of 
elements,  and  the  complexity-casual  structure.  Complexity 
is  also  significant,  to  a  lesser  degree.  The  mean  ending 
wealth  is  significantly  influenced  by  the  causal  structure 
and  the  number  of  elements. 

There  is  a  strong  emphasis  on  causal  structure  across 
all  four  dependent  variables.  The  number  of  elements  and, 
to  a  lesser  degree,  complexity  is  emphasized  across  three  of 
the  four  dependent  variables.  The  emphasis  on  the 
complexity-causal  structure  can  be  attributed  to  both 
parameters . 

Table  6  presents  the  results  for  the  do  nothing 
strategy.  The  complexity  and  the  complexity-causal 
structure  have  a  strong  emphasis  on  the  mean  wealth.  The 
wealth  standard  deviation  is  strongly  influenced  by  the 
complexity,  causal  structure,  and  the  number  of  elements. 

The  mean  periods  is  effected  by  the  causal  structure,  the 
mean  ending  wealth  is  strongly  influenced  by  the  complexity, 
causal  structure  and  the  combination  of  the  two. 

There  is  a  primary  emphasis  on  causal  structure, 
complexity,  and,  to  a  lesser  degree,  the  number  of  elements 
across  two  of  the  four  dependent  variables. 

Table  7  presents  the  results  for  the  weighted  moving 
average  strategy.  The  mean  wealth  is  strongly  influenced  by 
the  causal  structure  and  the  number  of  elements.  The  wealth 
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TABLE  5.  MAIN  EFFECTS  AND  INTERACTIONS  OF 

LEARNING  STRATEGY  USING  REGRESSION 


WLMEAN  WLSTD  PERIODS  ENOWL 


Effects  P 

F 

P 

F 

P 

F 

P 

F 

C 

0.0241 

5.23 

0.0422 

4.23 

0.0424 

4.22 

0.0623 

3.55 

CS 

0.0001 

74.84 

0.0001 

81.27 

0.0001 

75.35 

0.0001 

63.89 

TL 

0.2218 

1.51 

0.2939 

1.11 

0.5830 

0.30 

0.4233 

0.65 

NE 

0.2449 

1.37 

0.0001 

56.60 

0.0108 

6.73 

0.0001 

28.98 

CxCS 

0.0001 

11.31 

0.0006 

7.91 

0.0114 

4.66 

0.1670 

1.82 

CxTL 

0.1384 

2.23 

0.1996 

1.67 

0.6144 

0.26 

0.9804 

0.00 

CxNE 

0.1972 

1.68 

0.2151 

1.55 

0.6992 

0-15 

0.2782 

1.19 

KEY: 

C  =  Complexity 

CS  =  Causal  Structure 

TL  =  Time  Lag 

NE  =  Number  of  Elements 

WLMEAN  =  Mean  value  wealth 
WLSTD  =  Standard  deviation 
ENDWL  =  Ending  Wealth 

TABLE  6. 

MAIN  EFFECTS 
DO  NOTHING 

AND  INTERACTIONS 
STRATEGY 

OF 

— 

WLMEAN 

WLSTD 

PERIODS 

ENDWL 

Effects 

F 

P  F 

P  F 

P  F 

P 

C 

0.0433 

4.18 

0.0103 

6.82 

0.6397 

0.22 

0.0112 

6.66 

CS 

0.0646 

2.81 

0.0021 

6.51 

0.0015 

6.93 

0.0014 

6.94 

TL 

0.7541 

0.10 

0.5682 

0.33 

0.3366 

0.93 

0.9324 

0.01 

NE 

0.8105 

0.06 

0.0001 

38.12 

0.5007 

0.46 

0.6066 

0.27 

CxCS 

0.0032 

6.04 

0.2831 

1.28 

0.7918 

0.23 

0.0005 

8.26 

CxTL 

0.7964 

0.07 

0.5026 

0.45 

0.7117 

0.14 

0.8638 

0.03 

KEY:  C  =  Complexity  WLMEAN  =  Mean  value  wealth 

CS  =  Causal  Structure  WLSTD  =  Standard  deviation 

TL  =  Time  Lag  ENDWL  =  Ending  Wealth 

NE  =  Number  of  Elements 
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standard  deviation  is  strongly  effected  by  all  parameters 
except  for  the  time  lag,  and  the  complexity-time  lag.  The 
mean  period  is  strongly  influenced  by  the  causal  structure 
and  the  number  of  elements. 

There  is  a  strong  emphasis  on  causal  structure  and  the 
number  of  elements  across  mean  wealth,  mean  standard 
deviation  and  mean  periods.  Complexity  is  significant  for  a 
single  dependent  variables.  The  emphasis  on  the  complexity- 
causal  structure  is  a  result  of  the  effects  of  the  causal 
structure.  There  is  very  little  difference  in  the 
parameters  emphasized  in  the  weighted  rr.oving  average  and  the 
moving  average  strategies  (Table  8) .  In  both  cases,  all 
parameters  are  insignificant  when  determining  the  mean 
ending  wealth. 

Table  9  presents  the  results  from  the  constant 
arbitrary  strategy.  The  mean  wealth  is  strongly  influenced 
by  the  causal  structure  and  the  number  of  elements.  The 
wealth  standard  deviation  is  strongly  effected  by  the 
complexity,  causal  structure,  number  of  elements,  and  the 
complexity-causal  structure.  The  parameters  are 
insignificant  when  determining  the  mean  periods.  The  mean 
ending  wealth  is  strongly  influenced  by  the  causal 
structure. 

There  is  a  strong  emphasis  on  causal  structure  and  the 
number  of  elements  across  mean  wealth  and  wealth  standard 
deviation.  A  single  dependent  variable  emphasis  on 
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TABLE  7.  EFFECTS  AND  INTERACTIONS  OF 

NEIGHTED  MOVING  AVERAGE  STRATEGY 


WLMEAN  WLSTD  PERIODS  ENDWL 


Effects  P 

F 

P 

F 

P 

F 

P 

F 

C 

0.2258 

1.48 

0.0025 

9.56 

0.6638 

0.19 

0.3801 

0.78 

CS 

0.0001 

26.95 

0.0001 

28.45 

0.0001 

30.75 

0.4501 

0.80 

TL 

0.3730 

0.80 

0.1925 

1.72 

0.6386 

0.22 

0.3933 

0.73 

NE 

0.0001 

18.43 

0.0001 

81.75 

0.0001 

23.37 

0.3391 

0.92 

CxCS 

0.0674 

2.76 

0.0016 

6.84 

0.3337 

1.11 

0.4697 

0.76 

CxTL 

0.3611 

0.84 

0.1535 

2.07 

0.8963 

0.02 

0.3943 

0.73 

CxNE 

0.5336 

0.39 

0.0216 

5.43 

0.5679 

0.33 

0.3811 

0.77 

KEY :  C  =  Complexity  WLMEAN  =  Mean  value  wealth 

CS  =  Causal  Structure  WLSTD  =  Standard  deviation 

TL  =  Time  Lag  ENDWL  =  Ending  Wealth 

NE  =  Number  of  Elements 


TABLE  8.  MAIN  EFFECTS  AND  INTERACTIONS  OF 
MOVING  AVERAGE  STRATEGY 


WLMEAN  WLSTD  PERIODS  ENDWL 


Effects  P 

F 

P 

F 

P 

F 

P 

F 

C 

0.0855 

3.01 

0.0013 

10.88 

0.4279 

0.63 

0.6994 

0.15 

CS 

0.0001 

30.98 

0.0001 

19.16 

0.0001 

67.20 

0.1686 

1.81 

TL 

0.3853 

0.76 

0.1461 

2.14 

0.7260 

0.12 

0.8423 

0.04 

NE 

0.0001 

17.33 

0.0001 

105.46 

0.0001 

16.62 

0.0761 

3.21 

CxCS 

0.0158 

4.31 

0.0036 

5.93 

0.1229 

2.14 

0.9504 

0.05 

CxTL 

0.3427 

0,91 

0.2142 

1.56 

0.6796 

0.17 

0,9880 

0.00 

CxNE 

0.3129 

1.03 

0.0110 

6.69 

0.5998 

0.28 

0.9198 

0.01 

KEY:  C  =  Complexity  WLMEAN  =  Mean  value  wealth 

CS  =  Causal  Structure  WLSTD  =  Standard  deviation 

TL  =  Time  Lag  ENDWL  =  Ending  Wealth 

NE  =  Number  of  Elements 


complexity  and  the  complexity-causal  structure. 

Table  10  presents  the  results  of  the  random  arbitrary 
strategy.  The  mean  wealth  is  strongly  influenced  by  the 
causal  structure  and  the  number  of  elements.  The  wealth 
standard  deviation  is  strongly  effected  by  the  causal 
structure  and  the  number  of  elements.  The  mean  periods  is 
strongly  influenced  by  the  causal  structure  and  number  of 
elements.  The  system  parameters  are  insignificant  when 
determining  mean  ending  wealth. 

There  is  a  strong  emphasis  on  causal  structure  and  the 
number  of  elements  across  mean  wealth,  wealth  standard 
deviation,  and  mean  periods. 

Using  a  random  arbitrary  strategy  as  a  baseline  for 
assessing  performance,  helps  to  avoid  the  difficulties  of 
formulating  normative  models  for  dynamic  tasks  (Hogarth, 
1980;  Hogarth  and  Makridakis,  1981).  Second,  the  heuristics 
strategy  seems  to  be  within  human  capabilities,  indicating 
that  individuals  should  be  able  to  obtain  comparable  results 
which  maybe  confirmed  through  direct  experimentation.  From 
a  review  of  the  individual  strategies,  it  is  apparent  that 
the  causal  structure  and  the  number  of  elements  plays  a  very 
significant  part  in  the  strategies*  performance.  In  some 
instance,  complexity  was  significant,  but  normally  across  a 
single  dependent  variable.  However,  it  is  apparent  that 
time  lag  was  insignificant  in  determining  performance. 
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TABLE 

9.  MAIN 

EFFECTS  AND  INTERACTIONS  OF 

CONSTANT 

ARBITRARY 

STRATEGY 

WLMEAN 

WLSTD 

PERIODS 

ENDWL 

Effects  P 

F 

P 

F 

P 

F 

P 

F 

C 

0.4844 

0.49 

0.0322 

4.71 

0.9621 

0.00 

0.1330 

2.29 

CS 

O.OOOl 

13.00 

0.0001 

33.69 

0.3864 

0.96 

0.0293 

3.65 

TL 

0.2884 

1.14 

0.4277 

0.63 

0.9094 

0.01 

0.4063 

0.69 

NE 

0.0002 

14.99 

0.0001 

80.55 

0.2266 

1.48 

0.8870 

0.02 

CxCS 

0.1817 

1.73 

0.0148 

4.38 

0.8768 

0.13 

0.5342 

0.63 

CxTL 

0.4730 

0.52 

0.1384 

2.23 

0.8705 

0.03 

0.7582 

0.10 

CxNE 

0.7336 

0.12 

0.1047 

2.68 

0.8834 

0.02 

0.9648 

0.00 

KEY:  C  =  Complexity 

CS  =  Causal  Structure 

TL  =  Time  Lag 

NE  =  Number  of  Elements 

WLMEAN  =  Mean  value  wealth 
WLSTD  =  Standard  deviation 
ENDWL  =  Ending  Wealth 

TABLE  10.  MAIN  EFFECTS  AND  INTERACTIONS  OF 
RANDOM  ARBITRARY  STRATEGY 

WLMEAN 

WLSTD 

PERIODS 

ENDWL 

Effects  P 

F 

P 

F 

P 

F 

P 

F 

C  0.9911 

0.00 

0.1027 

2.71 

0.6957 

0.15 

0.8619 

0.03 

CS  0.0001 

16.00 

0.0001 

26.38 

0.0025 

6.32 

0.9137 

0.09 

TL  0.9390 

0.01 

0.7629 

0.09 

0.7691 

0.09 

0.9050 

0.01 

NE  0.0004 

13.56 

0.0001 

74.47 

0.0140 

6.24 

0.7945 

0.07 

CxCS  0.7266 

0.32 

0.2202 

1.53 

0.9596 

0.04 

0.9822 

0.02 

CxTL  0.9703 

0.00 

0.9065 

0.01 

0.9239 

0.01 

0.9922 

0.00 

CxNE  0.5995 

0.28 

0.3995 

0.72 

0.5114 

0.43 

0.9963 

0.00 

KEY:  C  =  Complexity 

CS  =  Causal  Structure 

TL  =  Time  Lag 

NE  =  Number  of  Elements 


WLMEAN  =  Mean  value  wealth 
WLSTD  =  Standard  deviation 
ENDWL  =  Ending  Wealth 
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The  results  from  the  experiment  fully  supports  the 
first  hypothesis  that  decision  processes  that  incorporate 
learning  would  out  perform  other  decision  processes 
interacting  in  similar  environment.  The  decision  strategy 
that  incorporated  regression  clearly  outperform  all  other 
strategies  in  overall  performance. 

However,  the  results  only  partially  support  the  second 
hypothesis  that  decision  processes  interacting  in  simple 
environments  would  out  perform  the  same  processes  in  complex 
environments.  Most  of  the  strategies  tend  to  support  this 
hypothesis  in  some  cases,  but  there  is  no  clear  statistical 
significance  between  performance  among  simple  and  complex 
decision  strategies. 
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V 


CONCLUSIONS 


A.  SUMMARY  OF  RESULTS 

The  objective  of  this  study  was  to  examine  the  quality 
of  decisions  made  by  individuals  in  dynamic  decision 
environments  and  how  the  quality  of  decisions  in  such 
environments  can  be  improved  through  decision  support  tools. 
Chapter  II  (section  B)  pointed  out  the  pitfalls  associated 
with  past  research  conducted  on  decision  making  in  discrete 
instances  and  emphasized  the  importance  of  recognizing 
decision  making  as  part  of  a  continuous  process.  Chapter  II 
(section  C)  discusses  the  general  framework  for  studying 
dynamic  decision  making  and  introduces  computer  simulation 
as  a  means  of  studying  dynamic  tasks. 

Chapter  II  (section  D)  explains  why  one  would  expect  a 
better  quality  of  decisions  to  be  made  when  examining 
decision  making  as  a  continuous  process  as  opposed  to 
discrete  incidents.  A  key  factor  to  enhancing  the  quality 
of  decisions,  is  the  role  that  feedback  plays.  The  results 
of  this  study  supports  this  finding.  As  the  analysis  of 
variance  test  showed,  there  is  a  significant  difference  in 
the  performance  of  feedback  oriented  decision  strategies  as 
compared  to  non-feedback  oriented  decision  strategies.  The 
decision  strategies  which  utilized  feedback  in  decision 
making  outperform  those  that  utilized  arbitrary  strategies. 
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However,  the  do  nothing  strategy  was  an  exception  to 
the  forementioned  results.  The  abnormal ies  occur  when  the 
casual  structure  is  positive.  This  is  not  surprising.  When 
left  uninterrupted,  positive  feedback  loops  tend  to  feed  on 
themselves  (Mackinnon  and  Wearing,  1985) .  An  example  of 
this  virtual  cycle  is  the  multiplier  accelerator  effect 
(Sterman,  1989b) . 

Secondly,  the  decision  strategy  which  incorporates 
learning  through  the  use  of  regression,  outperforms  four  of 
the  five  other  decision  strategies.  The  do  nothing  strategy 
produced  comparative  results. 

B.  SYST^&^^T  INCORPORATE  LEARNING 

The  results  of  this  study  provides  several  implications 

for  the  use  of  systems  that  incorporate  learning  as  decision 

support  tool.  This  study  shows  that  an  evaluation  of 

previous  decisions,  underlining  the  importance  of 

environmental  factors  surrounding  those  decisions,  enhances 

the  quality  of  the  decisions  made.  Because  of  the  limited 

(V 

cognitive  capacity  of  decision  maker  this  may  be  best 

A 

accomplished  through  the  development  of  learning  systems. 

Additionally,  this  study  supports  the  use  of  computer 
simulation  modeling  as  a  means  of  determining  conditions 
under  which  specific  decision  strategies  perform  better  than 
others  and  evaluating  the  affects  of  system  parameters. 
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The  implications  of  these  findings  for  command  decision 


making  indicate  that,  feedback  from  prior  military  actions 
or  engagements  can  play  an  important  role  in  adapting 
existing  systems  to  meet  military  roles  in  changing 
environments . 

C.  LIMITING  FACTORS  TO  GENERALI ZABILITY 

Because  there  is  an  infinitely  large  number  of  task 
environment-decision  strategy  combinations,  empirical 
simulations  alone  will  not  suffice  to  provide  generalizable 
results.  The  extent  to  which  this  approach  provides  useful 
insights  into  human  problem  solving  is  dependent  upon  how 
well  these  simulated  tasks  resemble  features  of  the  real 
world.  The  effects  of  different  types  of  combinations  of 
environments  and  decision  strategies  will  need  to  be  linked 
theoretically  to  the  abilities  and  limitations  of  the  human 
information-processing  system  (Hogarth,  1981) .  Experiments 
should  utilize  representative  designs  within  the  discrete 
framework  or  be  supported  by  direct  experimentation. 


D.  FUTURE  RESEARCH 

One  path  for  future  research  is  to  develop  simulation 
models  with  user  interfaces  that  allow  for  interactive 
gaming  such  that  proposed  decision  rules  can  be  replaced  by 
actual  subjects  (i.e.  direct  experiment  (Sterman,  1987)). 
The  subjects  are  given  freedom  to  make  decision  as  they 


42 


wish,  utilizing  the  same  structural  context  and  data  sets  as 
those  proposed  for  the  model  to  be  tested.  The  direct 
experiment  results  could  then  be  compared  to  the  results 
from  the  simulation  model  to  evaluate  the  adequacy  of  the 
modeled  decision  processes.  Research  in  this  context  will 
assist  in  establishing  acceptable  decision  rules  when  there 
is  no  primary  data  on  decision  making  available,  and  build 
confidence  in  the  simulation  model. 
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APPENDIX 


Yl* 
X2= 
X3  = 
X4  = 
X5=- 

Yl=- 
X2= 
X3=- 
X4  = 
X5=- 

Yl= 
X2  = 
X3  =  - 
X4  = 
X5  =  - 

Yl=- 
X2  = 
X3=- 
X4  = 
X5= 

Yl=- 
X2=- 
X3  =  - 
X4  = 
X5=- 

Yl=- 

X2=- 

X3=- 

X4=- 

X5=- 

Yl=- 
X2  =  - 
X3  =  - 
X4=- 
X5=- 


DECISION  MODELS  USED  IN  THE  EXPERIMENT 


0.09X4,.,  + 

-0.21X4,.,  + 

0 . 09X3, .,0+ 

0.44X3, .,4+  0.17X2., 4 

0.08X1,., 3+ 

-0.24X0,.,+  - 

-0.29X3,.*  +  -0.38X2,.,  +  0.00X1., 3 

0.00X2,.,  + 

0.15X4,.,  + 

0.18X2,.,  + 

0.46X3,.„+  -0.22X1,. ,3 

0.11X3,.,  + 

0.11X2,.,  + 

0.06X3,4  + 

0.07X3,.„+  0.65X0,.7 

0.34X0, .3  + 

0.03X0,.,  + 

-0.27X0,.3  + 

0.01X2,.,,+  -0.35X2,., 

0.2  3X3,.,  + 

0.48X3,.,2+ 

-0.2  3X4,., 3+ 

0.05X2,.,  +  0.01X4,.3 

0.08X1,.,  + 

0.63X2,.,  + 

0.01X3,.,  + 

-0.23X0,.,  +  0.04X3,4 

0.26X1,.,  + 

0.06X2,.,  + 

-0.34X0, .6  + 

0.01X1,.*  +  -0.33X3,.,2 

0. 12X4,.j4+ 

-0.21X3,4  + 

0.02X2,.,  + 

0.58X2,4  +  0.07X0,.,, 

0.39X4,.,  + 

0.42X3,.„+ 

0 . 09X2, .,0+ 

0.04X0,4  +  0.06X4,., 2 

0.82X2,.,,+ 

0.06X1,.,4+ 

0.06X3,.,,+ 

0.04X0,., 4+  0.03Xl,.,o 

0.03X4,.,'  + 

-0.27X1,.,,+ 

-0.37X4,.,  + 

0.05X1,.,,+  -0.27X1,., 

0.21X3,.,+ 

O.  11X0,.^  + 

0.4  6X1,.,'  + 

0.18X3,2  +  0.05X0,4 

0.51X1,.,  + 

0.00X3,.,  + 

-0.39X2,.,  + 

0.00X3,.3  +  0.09X0,4 

0.2  3X1,.,,,+ 

-0.28Xl,.y  + 

0.01X2,.,  + 

0.47X4,.2  +  0.01X3,., 

0.45X3,.g  + 

-0.03X3,.,,+ 

-0.48X0,4  + 

0.02X2,.5  +  -0.01X3,., 2 

0.15X3,.j  + 

0.15X1,.,,+ 

0.00X4,.,  + 

-0.22X1,.,  +  0.49X0,., 

0.69X1, .,4+ 

0.15X4,.,  + 

0.02X3,.*  + 

0.05X2,4  +  0.09X2,.7 

0.00X2,4  + 

0.07X4,4  + 

-0.47X2,.,  + 

-0.01X1, .3  +  -0.46X2,.,, 

0.00X2,.j  + 

-0.26X2,.,  + 

-0.03X0,.7  + 

0.10X3,.*  +  0.61X0,.2 

0.21X1,.,3+ 

0.00X1,.„+ 

-0.26X4,.3 

+ 

0.18X1,.,  + 

-0.34X2,.,3 

0. 38X2,.,4+ 

-0.25X1,.,2+ 

0. 10X2,.3 

+ 

-0.27X3,4  + 

0. 00X1,.7 

0.3  0X1,4  + 

0.00X0, .7  + 

-0.39X1,.3 

+ 

-0.27X2,.,3+ 

0.03X2,.* 

0.  llXl,.,u+ 

0.53X1,4  + 

-0.29X4,.3 

+ 

0.07X1,,,+ 

0.01XO,.,o 

0.24X2,.,,+ 

0.4  5X2,.,  + 

0. 11X1, .7 

+ 

0.14X1,.,,,+ 

0.06X2,4 

0.38X0, .7  +  -0.01X2,2  +  -0.12X2,.,  +  -0.49X0,.(,  +  -0.00X4, .3 
0.02X4,., 3+  -0.32X3,.,,+  -0.02X2,.^  +  -0.32X3,.,^+  -0.32X0,., 
0.17X4,.,,,+  -0.2  3X0,.,,+  -0.00X2,.,  +  -0.42X3,.,  +  -0.18X4,.^ 
0.4  0Xl,.e  +  -0.13X2,.,  +  -0.34X2,.,  +  -0.12X3,^  +  -0.01X3,., 
0.3  3X3, .,2+  -0.37X2,.2  +  -0.27X1,.,  +  -0.00X0,.,  +  -0.03X1,., 

0.11X1,.,,,+  -0.53X1,.,+  -0.29X4,.,  +  -0.07X1,.,,+  -0.01XO,.,o 
0.24X2,.,,+  -0.45X3,.,  +  -0.1 1X1, .7  +  -0.14Xl,.,o+  -0.06X2,., 
0.12X4,.,,+  -0.03X1,.,,+  -0.41X2,.,4+  -0.33X1,.,  +  -0.12X3,., 
0.01X4,.,'+  -0.11X3,.3  +  -0.31X1,.„  +  -0.25X1,.,  +  -0.32X4,., 
0.21X0,.,3+  -0.17X2,.2  +  -0.31X2,.,  +  -0.09X4, .,4+  -0.22X0, .3 
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Yl=  0.39X3,t,  +  -0.04X0^.,  +  -0.25X1,,„+  -0.31Xli.,  +  -0.00X3i^ 
X2  =  -0.22X3^ft  +  -0.37X0,.,  +  -0.03X1,.,  +  -0.37X4,.,  +  -0.01X4,., 4 
X3=-0.09X2,^  +  -0.38X1,.„+  -0.28X1,.,  +  -0.12X4,.,  +  -0.14X3,..; 

X4=-0. 67X2,.,  +  -0.02X4, .7  +  -0.15X3,.,,,+  -0.13X2,^  +  -0.03X3,.,3 

X5  =  -0.40X0,.,7+  -0.00X3,7  +  -0.04X2,.,  +  -0.54X3,.^  +  -0.02X1,.2 

Yl=-0. 20X1,14+  -0.59X3,.3  +  -0.14X1,^  +  -0.06X4,., 4+  -0.01X0,.2 

X2=-0. 39X4,7  +  -0.01Xl,.,o+  -0.32X3,.^  +  -0.01Xl,.,o+  -0.27X1,., 4 
X3=-0. 06X2,5  +  -0.02X1,., 2+  -0.62X2,.„+  -0.00X0,.*  +  -0.29X0, .6 
X4=-0. 06X1,3  +  -0.00X4,45  +  -0.29X2, .,2+  -0.06X2,.3  +  -0.59X1,.4 

X5=-0.00X0,^  +  -0.55X1,.6  +  -0.02X4,., 3+  -0.11X2,.*  +  -0.32X0, .7 

Yl=-0. 08X3,4,  +  -0.21X3,.3  +  -0.29X4,.*  +  -0.30X0,., 2+  -0.12X3,.9 

X2=-0. 2  6X0,.*  +  -0.02X0,.5  +  -0.06X4,.^  +  -0.15X0, .,3+  -0.51X3,.3 

X3=-0. 08X1,4,  +  -0.25Xl,.,o+  -0.33X4,4,  +  -0.23X4, .3  +  -0.12X2,., 2 
X4=-0. 35X1,.,  +  -0.29X4,.,  +  -0.09X2, .,4+  -0.16X1,.,  +  -0.11X0, .3 
X5=-0. 03X3,.,  +  -0.00X2,.,,+  -0 . 22X3,.,o+  -0.52X0,.,,+  -0.22X0,., 

Yl=  0.09X4,.5  +  0.21X4,.7  +  0.09X3,.,,,+  0.4  4X3, .,4+  0.17X2,., 4 

X2=  0.08Xli.,3+  0.24X0, .2  +  0.29X3,.*  +  0.38X2,.,  +  0.00X1,., 3 

X3=  0.00X2,3  +  0.15X4,., 3+  0.18X2,.,  +  0.46X3,.,,+  0.22X1,., 3 

X4=  0.11X3,.,  +  0.11X2, .,3+  0.06X3,.^  +  0.07X3,.„+  0.65X0,.7 

X5=  0.34X0,, ,  +  0.03X0,.,,  +  0.27X0, .3  +  0.01X2,.,,+  0.35X2,.9 

Yl=  0.23X3, .4  +  0.48X0, .,3+  0.23X4,.,,+  0.05X0,.g  +  O.OIXO,., 

X2=  0.08X1,5  +  0.63X2,7  +  0.01X3,5  +  0.23X0,.„  +  0.04X3,4, 

X3=  0.26X1,2  +  0.06X2,.,  +  0.34X0,.^  +  0.01X1,.*  +  0.33X3,., 2 

X4=  0.12X4, .,4+  0.21X3,4,  +  0.02X2,.,  +  0.58X2,.,  +  0.07X0,.,, 

X5=  0.39X4,.,  +  0.42X3,.,,+  0.09X2,.,,,+  0.04X2,.6  +  0.06X4,.,2 

Yl=  0.82X2,., 2+  0.06X1, .,4+  0.06X3,.,,+  0.04X0,., 4+  0.03Xl,.,o 
X2=  0.03X4,5  +  0.27X1, .,4+  0.37X4,.7  +  0.05X1,.,,+  0.27X1,., 

X3=  0.21X3,3  +  0.11X0,.,  +  0.46X1,.,  +  0.18X3,.2  +  0.05X0,.^ 

X4=  0.51X1,3  +  0.00X3,.2  +  0.39X2, .2  +  0.00X3,.,  +  0.09X0,4, 

X5=  0.23X1,.,,,+  0.28X1,.,  +  0.01X2,.2  +  0.47X4,.2  +  0.01X3,., 

Yl=  0.45X3,.*  +  0.03X3,.,,+  0.48X0,.^  +  0.02X2,.5  +  0.01X3,., 2 

X2=  0.15X3,.5  +  0.15X1,., 2+  0.00X4,.v  +  0.22X1,.,  +  0.49X0,., 

X3=  0.69X1,., 4+  0.15X4,.7  +  0.02X3,.*  +  0.05X2,4,  +  0.09X2,.7 

X4=  0.00X2,4,  +  0.07X4,4,  +  0.47X2,.,  +  0.01X1, .3  +  0.46X2,.,, 

X5=  0.00X2,.3  +  0.26X2,.7  +  O.OSXO,.,  +  0.10X3,.*  +  0.61X0,.2 

Yl=  0.32X0,4,  +  0.33X2,.,,,+  0.01X3,.,,,+  0.28X1,.,  +  0.06X3,.,o 

X2=  0.05X4,.7  +  0.49X0,.*  +  0.00X1,.,  +  0.00X3, .7  +  0.46X0,.6 

X3=  0.21X1,  ,3+  0.00X1,.3  +  0.26X4,.3  +  0.18X1,.,  +  0.34X2,. ,3 

X4=  0.38X2, .,4+  0.25X1,.3  +  0.10X2, .5  +  0.27X3,4,  +  0.00X1, .7 

X6=  0.30X1,44  +  0.00X0, .,3+  0.39X1,.3  +  0.27X2,., 3+  0.03X2,.* 

Yl  =  -0 . 2  3X3,4,2+  -0.25X1,.35+  0.07X3,4,,+  -0.09X2, .3,+  0.37X4,.33 

X2=  0.13X1,4,*+  0.39X3,.34+  0.30X3,.,^+  -0.16X2,.2*+  O.OIXO,.,,, 

X3=-0.22X0,.34+  0.02X1,4,3+  -0.17X2,.,^+  -0.27X0,4,5+  0.32X0,.25 
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X4=  0.42X0,,^+ 

O.  32X3,.,u+ 

-0. 09X3,., 5+ 

0.02X1,.36+  -0.16X1,.,, 

X5=-0. 25X0,^+ 

-0. 13X2,.27+ 

0. 39X0,.26+ 

-0.10X2,48+  -0.13X4,45 

Yl=  0.01X3, .31+ 

-0 . 09X0,.36+ 

0.35  X4,48+ 

0.53X4,.29+  0.02X4,48 

X2=  0.47X1, .33+ 

0.4  6X0, .26+ 

0.01X3,.„+ 

0.03X3,., 2+  0.06X2,36 

X3=  0.03X3,.3,+ 

0.05X1,47+ 

0. 51X0,.„+ 

0.32X2,.,o+  -0.10X4,.3g 

X4=  0.35X1,^»+ 

-0. 12X4i.35+ 

-0.1 8X2, .28+ 

0.00X0, .29+  0.34X3, .29 

X5=  0.07Xl,.3g+ 

0. 02X3, .36+ 

0.40X2,41  + 

-0.2  6X4, .39+  -0.25X1,48 

Y1=-0.12X4,.32+ 

-0.21X3,.29+ 

0.02X3,43+ 

0.56X3,40+  -0.09Xl,.2g 

X2=-0.29X4,.47+ 

0.01X1,41+ 

0.50X4,.27+ 

-0.17X4,46+  0.02X4,49 

X3=--0. 19X0,.47+ 

0.01X1,45+ 

0.35X1,.25+ 

0.34X4,.32+  -0.10X1,.36 

X4=  0.06X3,^+ 

0.00X4,.34+ 

0.56X2,.2g+ 

-0.29X4,43+  -0.10X2,44 

X5=  0.37X1,^+ 

-0. 18X1,35+ 

0.00X2,26+ 

0.00Xl,.3g+  0.44X4,.,, 

Yl=  0.01X4,.,^+ 

-0. 22X3,.2,+ 

-0.29X0,.35+ 

-0.12X3,41+  0.36X0,41 

X2=  0.82Xl,_j  + 

0. 02X0, .3,+ 

0.00X4,4,,+ 

0.03X3,.39+  -0.13X2,.,, 

X3  =  -0. 13X4,.4V+ 

0.78X1,4^+ 

0.03X3,.  ,6+ 

0.06X1,45+  0.00X2,49 

X4=  0.0 1X4,. 26+ 

0.3  3X4,.2> 

0.37X2,.,,+ 

0.0 1X3, .30+  -0.28X1,.26 

X5=-0.29X0,.34+ 

0.00  X  2,43+ 

0.01X0,.37+ 

-0.20X0,.32+  0.49X3,.,g 

Yl=-0. 19X1,36+ 

0.02X2,.27+ 

0.01X3,42+ 

-0.29X3,45+  0.50X2,44 

X2=-0. 17X4,36+ 

-0.27X3,43+ 

0.00X1,., 2+ 

0.3  3X0,48+  -0.2  3X2,.28 

X3=  0.00X2,.3,+ 

-0.29X0,43+ 

0.59X4,.28+ 

-0.10X3,45+  0.02X4,49 

X4=  0.06X0,.23+ 

-0 . 20X2,.32+ 

-0.09X2, .33+ 

0.31X0,42+  0.3  3Xl,.3g 

X5=-0.24X2,.27+ 

0.3  2X2, .37+ 

-0.28X1,.26+ 

-0.13X4, .35+  0.03X3,46 

Y1=-0.08X1,.41+ 

-0.3  3X0, .30+ 

-0.37X1,., 5+ 

-0.02X3, .30+  -0.20X4, .32 

X2=-0. 19X2,4,+ 

-0.33X3,45+ 

-0.36X4,.34+ 

-0.02  X  3,49+  -0.09X1,.35 

X3=-0. 07X4,46+ 

-0.30X1,.3,+ 

-0.01X1,43  + 

-0.39X4,45+  -0.23X2,48 

X4=-0.01X4,.35+ 

-0. 05X1, .38+ 

-0.13X3,.,o+ 

-0.43X3,41+  -0.37X2, .37 

X5=-0. 28X0,48+ 

-0.07X2,47+ 

-0.23X2,.27+ 

-0.01X3,.2g+  -0.41X2,40 

Yl=-0. 53X3,.35+ 

-0. 00X1,.3,+ 

-0 . 05X0,.39+ 

-0.07X2,.35+  -0.34X1,47 

X2=-0.25X3,.3,+ 

-0. 17X1,45+ 

-0.4  2X0,.26+ 

-0.14X4,45+  -0.03X1,.39 

X3=-0. 02X2,.3„+ 

-0. 33X0,.3,+ 

-0.09X1,47+ 

-0.48X3,.28+  -0.07X1,.25 

X4  =  -0, 30X2,.2.,+ 

-0.3  3X4, .33+ 

-0.01X4,35+ 

-0.29X3,.3o+  -0.07X3,4, 

X5  =  -0. 4  5X0,.4,+ 

-0. 50X1, .34+ 

-0.00X3,36+ 

-0.00  X  2,46+  -0.04  X  2, .26 

Y1  =  -0.06X1,.38+ 

-0.01X3,.,,,+ 

-0.22X4,4,,+ 

-0.28X2,40+  -0.4  3X3, .36 

X2=-0. 00X4,.26+ 

-0.02X2,..7+ 

-0 . 68X2,46+ 

-0.27X4,46+  -0.02X2,40 

X3=-0. 37X3,.36+ 

-0.34X0,45+ 

-0. 15X1,42+ 

-0.11X0,44+  -0.02X4,.36 

X4=-0.4  0X2,.33+ 

-0.56X4,.3,+ 

-0.01X2,.26+ 

-0.03X3, .29+  -0.00X0, .28 

X5=-0.02X3,.36+ 

-0.31X1,.3,+ 

-0.32X0,45+ 

-0.02  X  2,42+  -0.34X1,49 

Yl=-0. 10X3,.3„+ 

-0. 18X1, .3, + 

-0.28X3,.26+ 

-0.07X3,48+  -0.38X4,.38 

X2=-0.4  3X0,.34+ 

-0.42X0,46+ 

-0.0  3X0, .,2+ 

-0.03X3,.26+  -0.09X4,41 

X3=-0. 08X1,.3„+ 

-0. 19X4,.28+ 

-0.26X1,42+ 

-0.12X3,.25+  -0.3  5X5,.32 

X4=-0. 26X1,.26+ 

-0. 16X3,46+ 

-0.2  2X4, .26+ 

-0.29X1,46+  -0.07X2,49 

X5=-0. 04X3,.26+ 

-0. 35X4,.37+ 

-0.00X2,44+ 

-0.34X0,46+  -0.26X3,42 
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Yl  =  -0.4  5X0,.,t,+ 

-0. 2  0X0,^,,+ 

-0. 02X2, .77+ 

-0. 19X1,47+ 

-0. 14X2,25 

X2  =  -0. 02X4,^i<+ 

-0. 00X2,.„+ 

-0.45X3,4,+ 

—  0 . 50X0,44+ 

-0.03X2,.28 

X3  =  -0. 13X4,_,,+ 

-0.47X1,., 2+ 

-0. 17X0,43+ 

-0. 22X4,.„+ 

-0.00X2,.,2 

X4  =  -0. 33X2,.,s+ 

-0.28X3,.27+ 

-0. 11X2,37+ 

-0. 02X1,.39+ 

-0. 28X2,33 

X5=-0.2  6X3,^(,+ 

-0. 04X2,.sy+ 

-0.2  8X2,.  ,7+ 

-0.24X4,.2.,+ 

-0.20X1,39 

Yl=  0. 09X4, .334- 

0.07X1,.4,+ 

0.31X3,42+ 

0. 30X0,., 0+ 

0.22X4,.39 

X2=  0.08X1, ^7+ 

0.20X2,.45+ 

0. 13Xl,4g+ 

0. 3  5X3,45+ 

0.24X0,.2g 

X3=  0. 00X2, .29+ 

0.10X4,^6+ 

0.28X0,.,4+ 

0.4  3X1,.„+ 

0. 19X4,47 

X4=  0.18X3,.26+ 

0.04X4,.35+ 

0.46X0,34+ 

0. 14Xl,.3g+ 

0. 18X2,46 

X5=  0.4  9X0,.29+ 

O.  16X0,.4g+ 

0.25X0,49+ 

0. 04X2,47+ 

0. 05X0,39 

Yl=  0.17X3,.,9+ 

0.46X3,.3s+ 

0.00X3,.„  + 

0.  OOXl,.35+ 

0.36X0,45 

X2=  0.03X1, .32+ 

0.2 1X3, .35+ 

0.36X1,.33+ 

0.14X1,45+ 

0.25X2,.37 

X3=  0.58X1,.26+ 

0. 02X2,.3o+ 

0.05X3,.„+ 

0.24X0,.,,+ 

0. 12X2,.25 

X4=  0.08X4,.4^+ 

0. 36X2,2,+ 

0.02X1,4„+ 

0.4  0X4,.,,+ 

O.  13X3,.3o 

X5=  0.18X4,.25+ 

0.3  0X0,^,+ 

0. 01X1,.,„+ 

0. 3 3X1, .34+ 

0. 19X3,44 

Yl=  0.04X2,.2,+ 

0. 02X5,.,„+ 

0.21X3,44+ 

0 . 00X5,., 9+ 

0. 18Xl,.2g 

X2=  0.07X2,.4s+ 

0.  OOXO,.27+ 

0 . 02X5,.77+ 

0. 07X1,49+ 

0 . 00X0,.39 

X3=  0.05X5,.2,+ 

0.2  5X2,.2f,+ 

0. 10x1,49+ 

0.27X2,.,g+ 

0. 09X2,.2g 

X4=  0.14X3,.-,,+ 

0.2  6X4,4^+ 

0.0 1X2, .,7+ 

0.01X5,.,,+ 

0. 01X3,., 7 

X5=  0.05X4, .34+ 

0 . 05X2,.77+ 

0. 16X5,.,„+ 

0 . 07X2,.29+ 

0. 01X1,31 

Yl=  0.52X3,.,,+ 

0.16X3,.,,,+ 

0. 01X4,., 9+ 

0.28X1,.„+ 

0.04X4,43 

X2=  0.13X3,.,,+ 

0. 15X0,.4+ 

0.44X1,47+ 

0. 15X0,49+ 

0.13X1,49 

X3=  0.45X1,^,+ 

0.12X1,.,,,+ 

0 . 06X4,49+ 

0. 27X4,.2g+ 

0. 10X4, .35 

X4=  0.00X2,.,,+ 

0.57X1,.29+ 

0.0 1X4, .79+ 

0. 3  4X3,49+ 

0. 07X4,.3, 

X5=  O.OOX3,.3u+ 

0 . 05X3  ,.29+ 

0.41XO,.34+ 

0. 4 1X4, .37+ 

0. 14X2,.37 

Yl=  0.28X0,.,,+ 

0. 2  3X0,.39+ 

0. 10X1,.,9+ 

0. 10X0,4,,+ 

0.2  9X2,42 

X2=  0.06X4,., 7+ 

0. 02X4,4g+ 

0.26X4,.,9+ 

0. 00X3,., 5+ 

0.6  5X0,.39 

X3=  0.3  3X1,J,9+ 

0. 14X4,42+ 

0.00X2,.,7+ 

0.53X1,.32+ 

0.  OOXl,.29 

X4=  0.19X2,.49+ 

0.35X2,.,,+ 

0.04X0,.2^+ 

0. 30X3,.27+ 

0. 12X1,.3o 

X5=  0.27Xl,.,y+ 

0.36X3,49+ 

0. 3 1X2, .27+ 

0.05X2,.5o+ 

0.00X0,47 

Yl=  0.01X4,.6  + 

0.11X3,.,+ 

-O.  31X1,.„  + 

-0.25X0,.6  + 

-0.32X0,., 

X2=-0.21X0,,„+ 

0. 17X2,.2  + 

-0. 31X2,.9  + 

0.09X0,.,4+ 

-0.22X0,'.3 

X3=-0.39X3,.<,+ 

0.04X0,.s  + 

-0.2  5X0,.„+ 

-0.31X0,.,  + 

0. 00X0,4 

X4=-0.22X3,.y  + 

-0.37X0,.,  + 

0. 03X0,.„  + 

-0.37X0,.,  + 

0.0 1X0,. ,4 

X5=  0.09X2,.4  + 

-0. 38X1,.„+ 

-0.28X1,.,  + 

0. 12X0,.7  + 

0.14X0,.,, 

Yl=  0.03X3,.,+ 

0.00X2,.,,+ 

-0.22X3,.,,,+ 

0.52X0,.,,+ 

-0.22X0,.7 

X2=-0.38X0,.7  + 

0.01X2,.2  + 

0.12X2,.,  + 

0.49X0,.9  + 

-0. 00X0,.3 

X3=  0.02X4,.,,+ 

-0.32X3,.,,+ 

0.02X2,.2  + 

-0.32X0,.,,,+ 

-0.32X0,.3 

X4=  0.17X4,.,,,+ 

-0.23X0,.,,+ 

0.00X2,.,+ 

0.42X0,.,  + 

0.18X0,4 

X5=  0.40X2,.„  + 

0.13X2,.,+ 

-0.34X2,.,+ 

0. 12X0,4  + 

0.01X0,., 

Y1=-0.28X1,.4  + 

0. 11X3,., 4+ 

-0.24X3,.,,,+ 

0.00X0,.,,,+ 

-0.36X0,.3 

X2=-0. 25X0,.,4+ 

0.02X3,.,  + 

0.03X3,.,+ 

0.03X0,4  + 

0.67X0,., 3 
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X3=-0.25X4,.,  + 

0.16X3,.,  + 

X4=-0.27X3,.,2+ 

0.51X1,.,2+ 

X5=-0. 31X4,.7  + 

-0. 31X0,.i2+ 

Y1=-0.27X4,.,  + 

-0.23X3,.,+ 

X2=-0. 38X1,4  + 

0.00X2, .,2+ 

X3=-0.40X2,.,3+ 

0.06Xl,.g  + 

X4=  0.14X2,.,4+ 

0.00X4,.,+ 

X5=  0.05X2,.,+ 

-0.34X3,.7  + 

Yl=  0.12X0,.^  + 

0.  llXl,.,u+ 

X2=  0.00X2,4  + 

0.43X0,.,,+ 

X3=  0.44X1,.,+ 

-0.21X4,4  + 

X4=-0.36X3,.2  + 

0.02Xl,.g  + 

X5=  0.06X2,.,4+ 

-0.40X4,.,  + 

Yl=-0. 12X0,.,+ 

-0.  llXl,.,u+ 

X2=-0. 00X2,4  + 

-0.43X0,.,,+ 

X3=-0.44X1,,  + 

-0.21X4,4  + 

X4=-0.3  6X3,.2  + 

-0.02Xl,.g  + 

X5=-0.06X2i,,4+ 

-0.40X4,.,  + 

Yl=-0. 27X0,4  + 

-0.02X3,4  + 

X2=-0. 59X3,.,2+ 

-0.04X3, .,4+ 

X3=-0. 18X1,4  + 

-0.24X4,.,2+ 

X4=-0.06X1,.8  + 

-0.48X3,.,o+ 

X5=-0. 19X2,.„+ 

-0.04X3,.,+ 

Yl=-0. 00X1,4  + 

-0. 11X2,4  + 

X2=-0.21X1,.,2+ 

-0. 17X4,.,2+ 

X3=-0. 10X0,4  + 

-0. 14X3,.2  + 

X4=-0.27X4,.,+ 

-0.23X3,.,+ 

X5=-0. 38X1,4  + 

-0.00X2,., 2+ 

Y1=-0.40X2,.„+ 

-0.06Xl,.g  + 

X2=-0. 14X2,.,4+ 

-0.00X4,.,+ 

X3  =  -0.05X2,.,  + 

-0. 34X3,.7  + 

X4  =  -0. 02X1,.7  + 

-0.33X2,.,+ 

X5=-0. 00X3,.,  + 

-0.03X3,.7  + 

Yl=-0. 28X1,4  + 

-0. 11X3,., 4+ 

X2=-0.25X0,.,4+ 

-0.02X3,.,  + 

X3=-0.25X4,.3  + 

-0.16X3,.,  + 

X4=-0. 27X3,.,2+ 

-0.51X1,.,2+ 

X5=-0.31X4,.7  + 

-0.31X0,.,2+ 

Yl=  0.20X3,.,o+ 

0.1 8X1, .,2+ 

X2=  0.16X1, .,4+ 

0.37X0,.2  + 

X3=  0.16X0,., 6+ 

0.03X4,4  + 

X4=  0.26X0,4  + 

0.45X4,.,+ 

X5=  0.20X0,.,2+ 

0.48X0,.',  + 

0.03X1, .,2+  -0.3  0X0, .,2+  - 
0.01X3,^+  0.12X0,.,,+ 

-0.21X0i.4-*-  0.17X0,.,,+ 

0.00X0,.,+  0.17X0,.,+  - 

0.03X4,.,+  0.18X0,.,+ 

-0.33X3,.,+  0.01X0,.4-''  - 

-0.22X4,.„+  0.02X0,.2  + 

-0.27X4,.,+  -0.3 1X0, .,2+ 

0.1SX0,.,2+  -0.23X3,2+  - 
0.4  8X0, .,4+  0.08X4,.,o+ 

0.06X0,.,,+  -0.22X1,.,  + 
-0.21XO,.,o+  -0.39X1, .8  + 
0.18X0,.,,+  -0.2  3X4,.,o+ 

-0.18X3, .,2+  -0.23X0,. 2+  - 
-0.48X0,., 4+  -0.08X0,.,u+  • 
-0.06X3, .,2+  -0.22X0,.s+  - 
-0.21X0,.,,,+  -0.39X0,.g+  - 
-0.18X4,4,+  -0.23XO,.,o+  - 

-0.11X2,. 7+  -0.35X0,.6+  - 
-0.26X2,.j+  -0.07X3,.,o+ 
-0.14X0,., 2+  -0.19X0,.5  + 
-0.01X1,.,  +  -0.01XO,.,o+ 
-0.4  3X2,.,,+  -0.07X0,.,+ 

-0.4  5X4,.,+  -0.01X0,.,+ 
-0.00X3,.4+  -0.51X0,.,+ 
-0.20X2,^+  -0.31X0,.,,+ 
-0.00X0,.,+  -0.17X0,.,+ 
-0.03X4,.g+  -0.18X0,.,+ 

-0.33X3,.y+  -0.01X0,^  + 
-0.22X4,.,,+  -0.02X0,. 2  + 
-0.27X4,.,+  -0.3  1X0,., 2+ 
-0.16X4,.,,+  -0.46X0,4  + 


-0.01Xl,.g  + 

-0. 51X0,.7  + 

-0.24X3,.,,,+ 

-0. 00X0,., 0+ 

-0.03X3,.g  + 

-0. 03X0,4  + 

-0.03X1,.,2+ 

-0. 3 0X0,., 2+ 

-0.01X3,4  + 

-0.12X0,.,,+ 

-0.21X0,4  + 

-0. 17X0,.„+ 

0. 16X0,. 9  + 

0.3  3X0,. 5  + 

0.23X4,.„+ 

0. 02X0,4  + 

0.29X0,.2  + 

0.23X0,.,  + 

0. 19X3,.,4+ 

0. 10X0,4  + 

0.10X1,.,,+ 

0. 10X0, .,2+ 
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■0.26X0,.2 

0.09X0,.,, 

O.OOXO,.,o 

0.3  3X0,., 2 
0.4 1X0, 
0.20X0,., 
0.62X0,.,, 
0. 04X0,.8 

•0. 3 5X0, .2 
0.01X0,4 
0.07X0,., 
0.0 1X0,. ,2 
0. 13X0,.g 

-0.3  5X0, .2 
-0.0 1X0,. ,4 
•0.07X0,., 
•0.01X0,. ,2 
-0. 13X0,.g 

0.25X0,., 

-0.03X0,., 

-0.25X0,., 

-0.44X0,4 

-0.27X0,4 

'0 . 43X0,. ,2 
-0. 11X0,4 
-0.25XO,.,o 
0. 32X0,., 2 
•0.41X0,4 

-0.20X0,., 
-0.62X0,.,, 
-0. 04X0,.g 
•0.02X0,.g 
0.4  5X0,. ,4 

-0.3  6X0,., 
-0. 67X0,., 3 
-0.2  6X0, .2 
-0.0  9X0,., 3 
-0.  OOXO,.,o 

0. 13X2t.,3 

0.23X0,.g 
0.29X0,.,3 
0. 00X0,4 
0. 11X0,.,2 


r 

I 


Yl=  0.00X3,^  + 

0.3  6X3,.,  + 

0.3  6X0,.,  + 

0.01X0, ,4+ 

0.26X0,  ,4 

X2=  0.38X1,.,+ 

0.24X4,.,,,+ 

0.16X5,.„  + 

0.05X0,.7  + 

0.17X0,.,,, 

X3=  0.03X3,^  + 

0 . 54X2,., 4+ 

0.33X0,.,,+ 

0.09X0,.g  + 

0.01X0,., 

X4=  0.07X1, .,4+ 

0.07X2,.,+ 

0.61X2,7  + 

0.07X0,.,  + 

0. 18X0,.,4 

X5=  O.OIXI1.8  + 

0.4  3X1,.,,+ 

0.41X1,.5  + 

0.0  5X0, .,4+ 

0.10X0,.,, 

Yl=  0.20X4,.,+ 

0.03X4,.,,+ 

0.29X2,.4  + 

0. 14X0,. 2  + 

0.34X0,.,, 

X2=  0.54X4, .14+ 

0.27X2,.,  + 

0.0  7X0, .,4+ 

0.05X0,., 4+ 

0.07X0,., 

X3=  0.28X0,.,,+ 

0.10X1,.,,+ 

0.45X4,.7  + 

0. 15X0,. 7  + 

0.02X0,., 

X4=  0.05X3,.,,+ 

0 . 2 1X3, .9  + 

0.32Xl,.g  + 

0.08X0,.,,+ 

0.35X0,.,, 

X5=  0.22X1,.,,+ 

0.03X0,.5  + 

0.29X4,.,4+ 

0.27X0,4  + 

0.20X0,.2 

Yl=  0.01X4,.g  + 

0. 14X4,.7  + 

0.40X1-.,+ 

0.4  0X0,.,+ 

0.06X0,.7 

X2=  0.40Xl,.,o+ 

0.50Xl,.g  + 

0.03X0,.,,+ 

0.06X0,4  + 

0.01X0,4 

X3=  0.11X4, .,4+ 

0. 35X0,.,4+ 

0.49X2,.,+ 

0.00X0, .,4+ 

0.05X0,., 4 

X4=  0.01X4,.,+ 

0. 19X0,.g  + 

0.36X2,.5  + 

0.43X0,.,  + 

0.01X0,.5 

X5=  0.30X0,.6  + 

0.03X1,.5  + 

0. 16X2,.4  + 

0. 50X0,.g  + 

0.01X0,.g 

Yl=  0.22Xl,.g  + 

0.02X3,.,+ 

0.13X3, .,4+ 

0.60X0,.,,+ 

0. 03X0,.,4 

X2=  0.19X4,. 7  + 

0. 47X3,.4  + 

0.07X0,.,,,+ 

0.27X0,.,  + 

0.00X0,., 

X3=  0.00X2,.,+ 

0. 17X4,.7  + 

0.2  5X4,. 7  + 

0. 02X0, .,4+ 

0.56X0,., 

X4=  0.14X0,.,+ 

0 . 02X4,., ,1+ 

0.08X4,.„  + 

0. 74X0,.g  + 

0.02X0,.^ 

X5=  0.4  0X2,.,+ 

0.02X3,.,,,+ 

0.00X3,.„  + 

0. 04X0, .,2+ 

0. 54X0,. g 

Yl=-0. 09X4,.3,+ 

0.07X1,^,+ 

0.3 1X3, .42+ 

0. 30X0,., 0+ 

-0.22X0,.,,, 

X2=  0.08X1,.47+ 

-0 . 20X2,.45+ 

-0.13X1,^,+ 

0. 3  5  X  0,45+ 

-C.24X0,.2g 

X3=  0.00X2,.2,+ 

-0.10X4,^,+ 

-0.28X0,.„+ 

0.4  3X0,.,,+ 

-0. 19X0,47 

X4=-0. 18X3,.26+ 

0 . 04X4,.,,+ 

0 . 4  6X0, .,4+ 

-0. 14X0,.,g+ 

-0.18X0,4, 

X5=  0.4  9X0, .29+ 

-0. 16X0,J,g+ 

-0.25X0,.46+ 

0.04X0,47+ 

0 . 05XO,.39 

Yl=-0. 17X3,.39+ 

0.4  6X3,.,,+ 

0 . 00X3,.,,+ 

0.  OOXO,.35+ 

0. 3  6X0,45 

X2=  0.03X1, .32+ 

-0.21X3,.35+ 

0.36X1,.,,+ 

-0.14X0,45+ 

-0.25X0,.,7 

X3=  0.58X1,.,6+ 

0 . 02X2,.3Q+ 

0. 05X3,.„  + 

-0.24X0,.,,+ 

-0. 12X0,.25 

X4=  0.08X4,J,g+ 

0.3  6X2, .25+ 

0.02Xl,.4g+ 

0.40X0,.„+ 

-0. 13X0,.,(, 

X5=-0. 18X4,.25+ 

-0.3  0X0,.4,+ 

0.01Xl,.,g+ 

0.3  3X0,.,4+ 

-O.  19X0,44 

Y1=-0.25X1,.4,+ 

0 . 52X3,.2g+ 

—  0 . 2 2X3, .,7+ 

0.02X0,.,,+ 

0.00X0,4, 

X2=  0.4  4X0,^4+ 

-0. 08X4, .42+ 

-0.17X2,.,^+ 

-O.  11X0,4„+ 

—  0.2  0X0,.2g 

X3  =  -0.22X4,.,4+ 

-0.24X1,.,,+ 

0.42X0,.4„+ 

0. 01X0, .37+ 

-0.1 1X0, .2, 

X4=  0.03Xl,.,g+ 

0.4  8X1, .,7+ 

0 . 06X0,.j,5+ 

-0. 10X0,.2g+ 

0.34X0,4(, 

X5=  0.32X4,2,,+ 

-0.19X4,^,+ 

0.00X4,.4,+ 

-0. 15X0,.2g+ 

0. 34X0,4g 

Yl=  0.52X3,.3„+ 

-0.16X3,.,,,+ 

0.01X4,.,y+ 

-0.28X0,.,,+ 

0.04X0,4, 

X2  =  -0. 13X3,.,,+ 

-0. 15X0,.„+ 

0.4  4X1, ^2+ 

-0. 15X0,4,+ 

-0.13X0,4, 

X2=  0.4  5X1,.4;,+ 

-0.12X1,.,,,+ 

0 . 06X4,.4«+ 

-0. 27X0,.2g+ 

-0.10X0,.,, 

X4=  0.00X2,.,,+ 

0. 57X1,.29+ 

0.01X4,.,„+ 

0.3  4X0,4„+ 

0.07X0,.,, 

X5=  0.00X3,.,,,+ 

0 . 05X3, .9j,+ 

0 . 4  1X0, .‘,4+ 

0.41X0,.,7+ 

-0. 14X0,.,7 

Y1=-0.28X0,.„  + 

-0.23X0,.,^+ 

-0. 10Xl,.,4+ 

-0. 10X0,4(1+ 

-0.29X0,42 

X2=  0.06X4,.37+ 

0 . 02X4,.4g+ 

-0.26X4,.,„+ 

0. 00X0,.,5+ 

0 . 65X0,.,9 

X3=  0.33X1,.46+ 

-0. 14X4,^2+ 

0.0  0X2,., 2+ 

0. 53X0,.32+ 

0 . 00X0,.29 
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X4=-0. 19X2i^9+ 

0.35X2,.35+ 

0.04X0, .25+ 

-0. 30X0,.27+ 

-0. 12XO,.3o 

X5=-0.27X1,.3o+ 

0.36X3,.46+ 

0.3 1X2, .27+ 

0. 05XO,.5o+ 

0 . 00X0,47 

Y1=-0.23X3,^2+ 

-0.25X1,.35+ 

-0.07X3,41+ 

-0.09X0,.35+ 

-0.37X0,.33 

X2=-0.13Xl,^g+ 

-0.39X3,.34+ 

-0.30X3,.39+ 

-0. 16X0,.2g+ 

-0.0 1X0, .30 

X3=-0. 22X0^34+ 

-0.02X1, ^3+ 

-0.17X2, .39+ 

-0.27X0,45+ 

-0.32X0,.25 

X4=-0.42X0,.34+ 

-0.32X3i.3o+ 

-0 . 09X3,.35+ 

-0. 02X0,.39+ 

-0.16X0,.3, 

X5=-0.25X0,^+ 

-0.13X2^27+ 

-0.39X0,.29+ 

-0.10X0,48+ 

-0. 13X0,45 

Yl=-0. 01X3, . 3,4- 

-0 . 09X0,.39+ 

-0.35X4,48+ 

-0.53X0,.29+ 

— 0 . 02X0,48 

X2=-0.47X1,.33+ 

-0.4  6X0, .26+ 

-0.0 1X3, .33+ 

-0.00X0, .32+ 

-0.06X0,.36 

X3=-0. 03X3,,3,+ 

-0.05X1, ^7+ 

-0.51X0,.34+ 

-0.3  2X0, .30+ 

-0.10X0^38 

X4=-0.35Xl,^g+ 

-0. 12X4,.35+ 

-0. 18X2,.28+ 

-0. 00X0,.29+ 

— 0 . 3 4X0,. 29 

X5=-0.  07Xl,.3g+ 

-0.02X3,.36+ 

-0.40X2,41+ 

-0.26X0,.39+ 

—  0.25  X  0,48 

Yl=-0. 12X4,.,2+ 

-0.21X3,.2s+ 

-0.02X3,43+ 

—  0 . 56X0,40+ 

-0 . 09X0,.28 

X2=-0.29X4,^7+ 

-0.01X1,^,+ 

-0. 50X4,27+ 

-0. 17X0,46+ 

—  0 . 02X0,49 

X3=-0. 19X0^^7+ 

-0. 01X1,.45+ 

-0.35X1,.25+ 

-O.  3 4X0, .32+ 

-0. 10X0,.36 

X4=-0.06X3,^6+ 

-0.00X4,.34+ 

—  0 . 5 6X2, .28+ 

-0.29  X  0,43+ 

-0. 10X0,44 

X5=-0.37X1,^+ 

-0. 18X1,.35+ 

-0.00X2,.26+ 

-0. 00X0,.3g+ 

-0.44X0,.3i 

Yl=-0. 01X4,.3^+ 

-0 . 22X3,.29+ 

-0.29X0,.35+ 

-0. 12X0,41+ 

-0.36X0,41 

X2=-0.82X1,^2+ 

-0.02X0,.32+ 

-0 . 00X4,40+ 

-0. 03X0,.39+ 

-0. 13X0, .31 

X3=-0.13X4,.39+ 

-0.78X1,^2+ 

-0.03X3,.39+ 

-0.06X0,45+ 

— 0 . 00X0,49 

X4=-0.01X4,.26+ 

-O.  3  3X4,.26+ 

-0.37X2,.33+ 

-0.01XO,.3o+ 

-0.28X0, .26 

X5=-0.29X0,.34+ 

-0.00X2,43+ 

-0.01X0,.37+ 

-0. 20X0,.32+ 

-0.49X0,.38 

Y1=-0.19X1,.39+ 

-0. 02X2, .27+ 

-0.01X3,42+ 

-0.29X0,45+ 

-0.50X0,44 

X2=-0.17X4,.36+ 

-0.27  X  3,43+ 

-O.OOXl,.32+ 

-0.33  X  0,48+ 

-0.23X0,.28 

X3=-0.00X2,.3,+ 

-0.29X0,43+ 

-0.59X4, .28+ 

-O.  10X0,45+ 

-0. 02X0,49 

X4=-0. 06X0,.2^+ 

-0.20X2,,32+ 

-0.09X2,.33+ 

-0.31X0,42+ 

-0.3  3X0, .38 

X5=-0.24X2,.27+ 

-0. 3  2X2,.37+ 

-0.28X1,.29+ 

-0. 13X0,.35+ 

-0.03X0,46 

Y1=  0.08X1,^,+ 

0. 33XO,,3o+ 

0.37X1,.35+ 

0. 02X0,.3„+ 

0.20X0,.32 

X2=  0.19X2, ^3+ 

0.3  3X3,45+ 

0.36X4,.„+ 

0. 02X0,49+ 

0.09X0,.35 

X3=  0.07X4, .46+ 

0. 3 0X1, ,31+ 

0.01X1,43+ 

0. 39  X  0,45+ 

0. 2  3X0,48 

X4=  0.01X4,.„+ 

0 . 05Xl,,3g+ 

O.  13X3,3,,+ 

0.4  3X0,41+ 

O.  3 7X0,., 7 

X5=  0.2  8XO,.4g+ 

0.07  X  2,47+ 

0.2  3X2,27+ 

0. 01X0, .28+ 

0.41X0,4,, 

yi=  0.53X3,.3,+ 

0.00X1, .35+ 

0 , 05X0,. 39+ 

0. 07X0, .35+ 

0.34X0,47 

X2=  0.2  5X3, .35+ 

0.17X1,45+ 

0.42X0,.26+ 

0. 14X0,45+ 

0.03X0,.39 

X3=  0.02X2,.3y+ 

0.3  3XO,.3o+ 

0.09X1,47+ 

0. 48X0,.28+ 

0. 07X0,.25 

X4=  0.30X2,.25+ 

0. 3 3X4, .33+ 

0.01X4,.3,+ 

0. 29XO,.3o+ 

0.07X0,41 

X5=  0.4  5X0, .45+ 

0.50X1,.34+ 

0 . 00X3,.36+ 

0.00X0,46+ 

0.04X0,.26 

Yl=  0.2  0X5, .45+ 

0.00X5,43+ 

0.02  X2,45+ 

0. 00X0,46+ 

0.23X0,.34 

X2=  0.04X2,.44+ 

0.26X  3,43+ 

0.02X3,.26+ 

0.24X0,.3,+ 

0.01X0,48 

X3=  0.04Xli.2g+ 

0.19X2,40+ 

0 . 06X0,.39+ 

0 . 02X0,.39+ 

0.00X0,46 

X4=  0.14X1,.32+ 

0. 08X2,.33+ 

0.02X4,.25+ 

0. 01X0,.3g+ 

0. 12X0,47 

X5=  0.01X0, .44+ 

0. 19X3,.3j+ 

0.01X2,45+ 

0. 15X0,45+ 

0 .  OOXO,.27 
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yi=  o.iox3,,3u+ 
X2=  0.4  3X0, .34+ 
X3=  0.08X1,,3„+ 
X4=  0.2  6X1, .29+ 
X5=  0.04X3,.2ft+ 

0.  18X1, .31  + 
0.4  2X0, .49+ 
0. 19X4i.2»+ 
0.16X3,^+ 
0.3  5X4, .37+ 

0.2  8X3, .39+ 
0.0  3X0, .32+ 
0.26X1,4,+ 
0.2  2X4, .26+ 
0. 00X2,44+ 

0. 07X0,48+ 
0.03X0,.26+ 
0. 12XOi.25+ 
0.29X0,46+ 
0.34X0,46+ 

0. 38X0,.3g 
0. 09X0,4, 
0. 3  5X0,.32 
0. 07X0,49 

0.26X0,42 

Yl=  0.4  5X0,36+ 
X2=  0.02X4,^k+ 
X3=  0.13X4,.42+ 
X4=  0.3  3X2, .33+ 
X5=  0.25X3, .46+ 

0.20X0,40+ 
0.00X2,.35+ 
0.47X1i.32+ 
0.28X3, .27+ 
0. 04X2,.jo+ 

0.02X2,.27+ 
0.4  5  X  3,43+ 
0. 17X0,43+ 
0. 11X2,32+ 
0.2  8X2, .37+ 

0. 19X0,42+ 
0. 50X0,44+ 

0. 22X0,.34+ 
0. 02X0,., 9+ 

0.24X0,.25+ 

0. 14X0,25 
0. 03X0,.28 
0.  OOXO,.32 
0.28X0,.33 
0. 2 0X0, .39 
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